{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "Y57RMM1LEQmR"
   },
   "source": [
    "#  <span style=\"color:orange\">Binary Classification Tutorial (CLF101) - Level Beginner</span>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "GM-nQ7LqEQma"
   },
   "source": [
    "**Created using: PyCaret 2.0** <br />\n",
    "**Date Updated: August 24, 2020**\n",
    "\n",
    "# 1.0 Tutorial Objective\n",
    "Welcome to the Binary Classification Tutorial (CLF101) - Level Beginner. This tutorial assumes that you are new to PyCaret and looking to get started with Binary Classification using the `pycaret.classification` Module.\n",
    "\n",
    "In this tutorial we will learn:\n",
    "\n",
    "\n",
    "* **Getting Data:**  How to import data from PyCaret repository\n",
    "* **Setting up Environment:**  How to setup an experiment in PyCaret and get started with building classification models\n",
    "* **Create Model:**  How to create a model, perform stratified cross validation and evaluate classification metrics\n",
    "* **Tune Model:**  How to automatically tune the hyper-parameters of a classification model\n",
    "* **Plot Model:**  How to analyze model performance using various plots\n",
    "* **Finalize Model:** How to finalize the best model at the end of the experiment\n",
    "* **Predict Model:**  How to make predictions on new / unseen data\n",
    "* **Save / Load Model:**  How to save / load a model for future use\n",
    "\n",
    "Read Time : Approx. 30 Minutes\n",
    "\n",
    "\n",
    "## 1.1 Installing PyCaret\n",
    "The first step to get started with PyCaret is to install pycaret. Installation is easy and will only take a few minutes. Follow the instructions below:\n",
    "\n",
    "#### Installing PyCaret in Local Jupyter Notebook\n",
    "`pip install pycaret`  <br />\n",
    "\n",
    "#### Installing PyCaret on Google Colab or Azure Notebooks\n",
    "`!pip install pycaret`\n",
    "\n",
    "\n",
    "## 1.2 Pre-Requisites\n",
    "- Python 3.6 or greater\n",
    "- PyCaret 2.0 or greater\n",
    "- Internet connection to load data from pycaret's repository\n",
    "- Basic Knowledge of Binary Classification\n",
    "\n",
    "## 1.3 For Google colab users:\n",
    "If you are running this notebook on Google colab, run the following code at top of your notebook to display interactive visuals.<br/>\n",
    "<br/>\n",
    "`from pycaret.utils import enable_colab` <br/>\n",
    "`enable_colab()`\n",
    "\n",
    "\n",
    "## 1.4 See also:\n",
    "- __[Binary Classification Tutorial (CLF102) - Intermediate Level](https://github.com/pycaret/pycaret/blob/master/tutorials/Binary%20Classification%20Tutorial%20Level%20Intermediate%20-%20CLF102.ipynb)__\n",
    "- __[Binary Classification Tutorial (CLF103) - Expert Level](https://github.com/pycaret/pycaret/blob/master/tutorials/Binary%20Classification%20Tutorial%20Level%20Expert%20-%20CLF103.ipynb)__"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "2DJaOwC_EQme"
   },
   "source": [
    "# 2.0 What is Binary Classification?\n",
    "Binary classification is a supervised machine learning technique where the goal is to predict categorical class labels which are discrete and unoredered such as Pass/Fail, Positive/Negative, Default/Not-Default etc. A few real world use cases for classification are listed below:\n",
    "\n",
    "- Medical testing to determine if a patient has a certain disease or not - the classification property is the presence of the disease.\n",
    "- A \"pass or fail\" test method or quality control in factories, i.e. deciding if a specification has or has not been met – a go/no-go classification.\n",
    "- Information retrieval, namely deciding whether a page or an article should be in the result set of a search or not – the classification property is the relevance of the article, or the usefulness to the user.\n",
    "\n",
    "__[Learn More about Binary Classification](https://medium.com/@categitau/in-one-of-my-previous-posts-i-introduced-machine-learning-and-talked-about-the-two-most-common-c1ac6e18df16)__"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "XC3kSuueEQmh"
   },
   "source": [
    "# 3.0 Overview of the Classification Module in PyCaret\n",
    "PyCaret's classification module (`pycaret.classification`) is a supervised machine learning module which is used for classifying the elements into a binary group based on various techniques and algorithms. Some common use cases of classification problems include predicting customer default (yes or no), customer churn (customer will leave or stay), disease found (positive or negative).\n",
    "\n",
    "The PyCaret classification module can be used for Binary or Multi-class classification problems. It has over 18 algorithms and 14 plots to analyze the performance of models. Be it hyper-parameter tuning, ensembling or advanced techniques like stacking, PyCaret's classification module has it all."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "aAKRo-EbEQml"
   },
   "source": [
    "# 4.0 Dataset for the Tutorial"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "VLKxlFjrEQmq"
   },
   "source": [
    "For this tutorial we will use a dataset from UCI called **Default of Credit Card Clients Dataset**. This dataset contains information on default payments, demographic factors, credit data, payment history, and billing statements of credit card clients in Taiwan from April 2005 to September 2005. There are 24,000 samples and 25 features. Short descriptions of each column are as follows:\n",
    "\n",
    "- **ID:** ID of each client\n",
    "- **LIMIT_BAL:** Amount of given credit in NT dollars (includes individual and family/supplementary credit)\n",
    "- **SEX:** Gender (1=male, 2=female)\n",
    "- **EDUCATION:** (1=graduate school, 2=university, 3=high school, 4=others, 5=unknown, 6=unknown)\n",
    "- **MARRIAGE:** Marital status (1=married, 2=single, 3=others)\n",
    "- **AGE:** Age in years\n",
    "- **PAY_0 to PAY_6:** Repayment status by n months ago (PAY_0 = last month ... PAY_6 = 6 months ago) (Labels: -1=pay duly, 1=payment delay for one month, 2=payment delay for two months, ... 8=payment delay for eight months, 9=payment delay for nine months and above)\n",
    "- **BILL_AMT1 to BILL_AMT6:** Amount of bill statement by n months ago ( BILL_AMT1 = last_month .. BILL_AMT6 = 6 months ago)\n",
    "- **PAY_AMT1 to PAY_AMT6:** Amount of payment by n months ago ( BILL_AMT1 = last_month .. BILL_AMT6 = 6 months ago)\n",
    "- **default:** Default payment (1=yes, 0=no) `Target Column`\n",
    "\n",
    "#### Dataset Acknowledgement:\n",
    "Lichman, M. (2013). UCI Machine Learning Repository. Irvine, CA: University of California, School of Information and Computer Science.\n",
    "\n",
    "The original dataset and data dictionary can be __[found here.](https://archive.ics.uci.edu/ml/datasets/default+of+credit+card+clients)__ "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "Ui_rALqYEQmv"
   },
   "source": [
    "# 5.0 Getting the Data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "BfqIMeJNEQmz"
   },
   "source": [
    "You can download the data from the original source __[found here](https://archive.ics.uci.edu/ml/datasets/default+of+credit+card+clients)__ and load it using pandas __[(Learn How)](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.read_csv.html)__ or you can use PyCaret's data respository to load the data using the `get_data()` function (This will require an internet connection)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 211
    },
    "colab_type": "code",
    "id": "lUvE187JEQm3",
    "outputId": "8741262c-0e33-4ec0-b54d-3c8fb41e52c0"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>LIMIT_BAL</th>\n",
       "      <th>SEX</th>\n",
       "      <th>EDUCATION</th>\n",
       "      <th>MARRIAGE</th>\n",
       "      <th>AGE</th>\n",
       "      <th>PAY_1</th>\n",
       "      <th>PAY_2</th>\n",
       "      <th>PAY_3</th>\n",
       "      <th>PAY_4</th>\n",
       "      <th>PAY_5</th>\n",
       "      <th>...</th>\n",
       "      <th>BILL_AMT4</th>\n",
       "      <th>BILL_AMT5</th>\n",
       "      <th>BILL_AMT6</th>\n",
       "      <th>PAY_AMT1</th>\n",
       "      <th>PAY_AMT2</th>\n",
       "      <th>PAY_AMT3</th>\n",
       "      <th>PAY_AMT4</th>\n",
       "      <th>PAY_AMT5</th>\n",
       "      <th>PAY_AMT6</th>\n",
       "      <th>default</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>20000</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>24</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-2</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>689.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>90000</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>34</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>14331.0</td>\n",
       "      <td>14948.0</td>\n",
       "      <td>15549.0</td>\n",
       "      <td>1518.0</td>\n",
       "      <td>1500.0</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>5000.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>50000</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>37</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>28314.0</td>\n",
       "      <td>28959.0</td>\n",
       "      <td>29547.0</td>\n",
       "      <td>2000.0</td>\n",
       "      <td>2019.0</td>\n",
       "      <td>1200.0</td>\n",
       "      <td>1100.0</td>\n",
       "      <td>1069.0</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>50000</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>57</td>\n",
       "      <td>-1</td>\n",
       "      <td>0</td>\n",
       "      <td>-1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>20940.0</td>\n",
       "      <td>19146.0</td>\n",
       "      <td>19131.0</td>\n",
       "      <td>2000.0</td>\n",
       "      <td>36681.0</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>9000.0</td>\n",
       "      <td>689.0</td>\n",
       "      <td>679.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>50000</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>37</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>19394.0</td>\n",
       "      <td>19619.0</td>\n",
       "      <td>20024.0</td>\n",
       "      <td>2500.0</td>\n",
       "      <td>1815.0</td>\n",
       "      <td>657.0</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>800.0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 24 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "   LIMIT_BAL  SEX  EDUCATION  MARRIAGE  AGE  PAY_1  PAY_2  PAY_3  PAY_4  \\\n",
       "0      20000    2          2         1   24      2      2     -1     -1   \n",
       "1      90000    2          2         2   34      0      0      0      0   \n",
       "2      50000    2          2         1   37      0      0      0      0   \n",
       "3      50000    1          2         1   57     -1      0     -1      0   \n",
       "4      50000    1          1         2   37      0      0      0      0   \n",
       "\n",
       "   PAY_5  ...  BILL_AMT4  BILL_AMT5  BILL_AMT6  PAY_AMT1  PAY_AMT2  PAY_AMT3  \\\n",
       "0     -2  ...        0.0        0.0        0.0       0.0     689.0       0.0   \n",
       "1      0  ...    14331.0    14948.0    15549.0    1518.0    1500.0    1000.0   \n",
       "2      0  ...    28314.0    28959.0    29547.0    2000.0    2019.0    1200.0   \n",
       "3      0  ...    20940.0    19146.0    19131.0    2000.0   36681.0   10000.0   \n",
       "4      0  ...    19394.0    19619.0    20024.0    2500.0    1815.0     657.0   \n",
       "\n",
       "   PAY_AMT4  PAY_AMT5  PAY_AMT6  default  \n",
       "0       0.0       0.0       0.0        1  \n",
       "1    1000.0    1000.0    5000.0        0  \n",
       "2    1100.0    1069.0    1000.0        0  \n",
       "3    9000.0     689.0     679.0        0  \n",
       "4    1000.0    1000.0     800.0        0  \n",
       "\n",
       "[5 rows x 24 columns]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "from pycaret.datasets import get_data\n",
    "dataset = get_data('credit')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 33
    },
    "colab_type": "code",
    "id": "kMqDGBkJEQnN",
    "outputId": "b2015b7a-4c1a-4377-d9cf-3e9ac5ce3ea2"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(24000, 24)"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#check the shape of data\n",
    "dataset.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "LyGFryEhEQne"
   },
   "source": [
    "In order to demonstrate the `predict_model()` function on unseen data, a sample of 1200 records has been withheld from the original dataset to be used for predictions. This should not be confused with a train/test split as this particular split is performed to simulate a real life scenario. Another way to think about this is that these 1200 records are not available at the time when the machine learning experiment was performed."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 50
    },
    "colab_type": "code",
    "id": "hXmaL1xFEQnj",
    "outputId": "f1f62a7d-5d3d-4832-ee00-a4d20ee39c41"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Data for Modeling: (22800, 24)\n",
      "Unseen Data For Predictions: (1200, 24)\n"
     ]
    }
   ],
   "source": [
    "data = dataset.sample(frac=0.95, random_state=786)\n",
    "data_unseen = dataset.drop(data.index)\n",
    "data.reset_index(inplace=True, drop=True)\n",
    "data_unseen.reset_index(inplace=True, drop=True)\n",
    "print('Data for Modeling: ' + str(data.shape))\n",
    "print('Unseen Data For Predictions: ' + str(data_unseen.shape))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "y9s9wNcjEQn0"
   },
   "source": [
    "# 6.0 Setting up Environment in PyCaret"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "ZlA01j6NEQn7"
   },
   "source": [
    "The `setup()` function initializes the environment in pycaret and creates the transformation pipeline to prepare the data for modeling and deployment. `setup()` must be called before executing any other function in pycaret. It takes two mandatory parameters: a pandas dataframe and the name of the target column. All other parameters are optional and are used to customize the pre-processing pipeline (we will see them in later tutorials).\n",
    "\n",
    "When `setup()` is executed, PyCaret's inference algorithm will automatically infer the data types for all features based on certain properties. The data type should be inferred correctly but this is not always the case. To account for this, PyCaret displays a table containing the features and their inferred data types after `setup()` is executed. If all of the data types are correctly identified `enter` can be pressed to continue or `quit` can be typed to end the expriment. Ensuring that the data types are correct is of fundamental importance in PyCaret as it automatically performs a few pre-processing tasks which are imperative to any machine learning experiment. These tasks are performed differently for each data type which means it is very important for them to be correctly configured.\n",
    "\n",
    "In later tutorials we will learn how to overwrite PyCaret's infered data type using the `numeric_features` and `categorical_features` parameters in `setup()`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "BOmRR0deEQoA"
   },
   "outputs": [],
   "source": [
    "from pycaret.classification import *"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 803
    },
    "colab_type": "code",
    "id": "k2IuvfDHEQoO",
    "outputId": "c7754ae9-b060-4218-b6f0-de65a815aa3a",
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Setup Succesfully Completed!\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "</style><table id=\"T_36a783b8_e609_11ea_b36d_482ae32b83da\" ><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >Description</th>        <th class=\"col_heading level0 col1\" >Value</th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row0\" class=\"row_heading level0 row0\" >0</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow0_col0\" class=\"data row0 col0\" >session_id</td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow0_col1\" class=\"data row0 col1\" >123</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row1\" class=\"row_heading level0 row1\" >1</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow1_col0\" class=\"data row1 col0\" >Target Type</td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow1_col1\" class=\"data row1 col1\" >Binary</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row2\" class=\"row_heading level0 row2\" >2</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow2_col0\" class=\"data row2 col0\" >Label Encoded</td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow2_col1\" class=\"data row2 col1\" >None</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row3\" class=\"row_heading level0 row3\" >3</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow3_col0\" class=\"data row3 col0\" >Original Data</td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow3_col1\" class=\"data row3 col1\" >(22800, 24)</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row4\" class=\"row_heading level0 row4\" >4</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow4_col0\" class=\"data row4 col0\" >Missing Values </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow4_col1\" class=\"data row4 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row5\" class=\"row_heading level0 row5\" >5</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow5_col0\" class=\"data row5 col0\" >Numeric Features </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow5_col1\" class=\"data row5 col1\" >14</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row6\" class=\"row_heading level0 row6\" >6</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow6_col0\" class=\"data row6 col0\" >Categorical Features </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow6_col1\" class=\"data row6 col1\" >9</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row7\" class=\"row_heading level0 row7\" >7</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow7_col0\" class=\"data row7 col0\" >Ordinal Features </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow7_col1\" class=\"data row7 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row8\" class=\"row_heading level0 row8\" >8</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow8_col0\" class=\"data row8 col0\" >High Cardinality Features </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow8_col1\" class=\"data row8 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row9\" class=\"row_heading level0 row9\" >9</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow9_col0\" class=\"data row9 col0\" >High Cardinality Method </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow9_col1\" class=\"data row9 col1\" >None</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row10\" class=\"row_heading level0 row10\" >10</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow10_col0\" class=\"data row10 col0\" >Sampled Data</td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow10_col1\" class=\"data row10 col1\" >(22800, 24)</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row11\" class=\"row_heading level0 row11\" >11</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow11_col0\" class=\"data row11 col0\" >Transformed Train Set</td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow11_col1\" class=\"data row11 col1\" >(15959, 91)</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row12\" class=\"row_heading level0 row12\" >12</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow12_col0\" class=\"data row12 col0\" >Transformed Test Set</td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow12_col1\" class=\"data row12 col1\" >(6841, 91)</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row13\" class=\"row_heading level0 row13\" >13</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow13_col0\" class=\"data row13 col0\" >Numeric Imputer </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow13_col1\" class=\"data row13 col1\" >mean</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row14\" class=\"row_heading level0 row14\" >14</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow14_col0\" class=\"data row14 col0\" >Categorical Imputer </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow14_col1\" class=\"data row14 col1\" >constant</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row15\" class=\"row_heading level0 row15\" >15</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow15_col0\" class=\"data row15 col0\" >Normalize </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow15_col1\" class=\"data row15 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row16\" class=\"row_heading level0 row16\" >16</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow16_col0\" class=\"data row16 col0\" >Normalize Method </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow16_col1\" class=\"data row16 col1\" >None</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row17\" class=\"row_heading level0 row17\" >17</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow17_col0\" class=\"data row17 col0\" >Transformation </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow17_col1\" class=\"data row17 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row18\" class=\"row_heading level0 row18\" >18</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow18_col0\" class=\"data row18 col0\" >Transformation Method </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow18_col1\" class=\"data row18 col1\" >None</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row19\" class=\"row_heading level0 row19\" >19</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow19_col0\" class=\"data row19 col0\" >PCA </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow19_col1\" class=\"data row19 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row20\" class=\"row_heading level0 row20\" >20</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow20_col0\" class=\"data row20 col0\" >PCA Method </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow20_col1\" class=\"data row20 col1\" >None</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row21\" class=\"row_heading level0 row21\" >21</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow21_col0\" class=\"data row21 col0\" >PCA Components </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow21_col1\" class=\"data row21 col1\" >None</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row22\" class=\"row_heading level0 row22\" >22</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow22_col0\" class=\"data row22 col0\" >Ignore Low Variance </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow22_col1\" class=\"data row22 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row23\" class=\"row_heading level0 row23\" >23</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow23_col0\" class=\"data row23 col0\" >Combine Rare Levels </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow23_col1\" class=\"data row23 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row24\" class=\"row_heading level0 row24\" >24</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow24_col0\" class=\"data row24 col0\" >Rare Level Threshold </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow24_col1\" class=\"data row24 col1\" >None</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row25\" class=\"row_heading level0 row25\" >25</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow25_col0\" class=\"data row25 col0\" >Numeric Binning </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow25_col1\" class=\"data row25 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row26\" class=\"row_heading level0 row26\" >26</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow26_col0\" class=\"data row26 col0\" >Remove Outliers </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow26_col1\" class=\"data row26 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row27\" class=\"row_heading level0 row27\" >27</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow27_col0\" class=\"data row27 col0\" >Outliers Threshold </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow27_col1\" class=\"data row27 col1\" >None</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row28\" class=\"row_heading level0 row28\" >28</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow28_col0\" class=\"data row28 col0\" >Remove Multicollinearity </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow28_col1\" class=\"data row28 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row29\" class=\"row_heading level0 row29\" >29</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow29_col0\" class=\"data row29 col0\" >Multicollinearity Threshold </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow29_col1\" class=\"data row29 col1\" >None</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row30\" class=\"row_heading level0 row30\" >30</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow30_col0\" class=\"data row30 col0\" >Clustering </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow30_col1\" class=\"data row30 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row31\" class=\"row_heading level0 row31\" >31</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow31_col0\" class=\"data row31 col0\" >Clustering Iteration </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow31_col1\" class=\"data row31 col1\" >None</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row32\" class=\"row_heading level0 row32\" >32</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow32_col0\" class=\"data row32 col0\" >Polynomial Features </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow32_col1\" class=\"data row32 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row33\" class=\"row_heading level0 row33\" >33</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow33_col0\" class=\"data row33 col0\" >Polynomial Degree </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow33_col1\" class=\"data row33 col1\" >None</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row34\" class=\"row_heading level0 row34\" >34</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow34_col0\" class=\"data row34 col0\" >Trignometry Features </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow34_col1\" class=\"data row34 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row35\" class=\"row_heading level0 row35\" >35</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow35_col0\" class=\"data row35 col0\" >Polynomial Threshold </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow35_col1\" class=\"data row35 col1\" >None</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row36\" class=\"row_heading level0 row36\" >36</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow36_col0\" class=\"data row36 col0\" >Group Features </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow36_col1\" class=\"data row36 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row37\" class=\"row_heading level0 row37\" >37</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow37_col0\" class=\"data row37 col0\" >Feature Selection </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow37_col1\" class=\"data row37 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row38\" class=\"row_heading level0 row38\" >38</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow38_col0\" class=\"data row38 col0\" >Features Selection Threshold </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow38_col1\" class=\"data row38 col1\" >None</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row39\" class=\"row_heading level0 row39\" >39</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow39_col0\" class=\"data row39 col0\" >Feature Interaction </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow39_col1\" class=\"data row39 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row40\" class=\"row_heading level0 row40\" >40</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow40_col0\" class=\"data row40 col0\" >Feature Ratio </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow40_col1\" class=\"data row40 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row41\" class=\"row_heading level0 row41\" >41</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow41_col0\" class=\"data row41 col0\" >Interaction Threshold </td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow41_col1\" class=\"data row41 col1\" >None</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row42\" class=\"row_heading level0 row42\" >42</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow42_col0\" class=\"data row42 col0\" >Fix Imbalance</td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow42_col1\" class=\"data row42 col1\" >False</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_36a783b8_e609_11ea_b36d_482ae32b83dalevel0_row43\" class=\"row_heading level0 row43\" >43</th>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow43_col0\" class=\"data row43 col0\" >Fix Imbalance Method</td>\n",
       "                        <td id=\"T_36a783b8_e609_11ea_b36d_482ae32b83darow43_col1\" class=\"data row43 col1\" >SMOTE</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x1a14d1c27c8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "exp_clf101 = setup(data = data, target = 'default', session_id=123) "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "JJSOhIOxEQoY"
   },
   "source": [
    "Once the setup has been succesfully executed it prints the information grid which contains several important pieces of information. Most of the information is related to the pre-processing pipeline which is constructed when `setup()` is executed. The majority of these features are out of scope for the purposes of this tutorial however a few important things to note at this stage include:\n",
    "\n",
    "- **session_id :**  A pseduo-random number distributed as a seed in all functions for later reproducibility. If no `session_id` is passed, a random number is automatically generated that is distributed to all functions. In this experiment, the `session_id` is set as `123` for later reproducibility.<br/>\n",
    "<br/>\n",
    "- **Target Type :**  Binary or Multiclass. The Target type is automatically detected and shown. There is no difference in how the experiment is performed for Binary or Multiclass problems. All functionalities are identical.<br/>\n",
    "<br/>\n",
    "- **Label Encoded :**  When the Target variable is of type string (i.e. 'Yes' or 'No') instead of 1 or 0, it automatically encodes the label into 1 and 0 and displays the mapping (0 : No, 1 : Yes) for reference. In this experiment no label encoding is required since the target variable is of type numeric. <br/>\n",
    "<br/>\n",
    "- **Original Data :**  Displays the original shape of the dataset. In this experiment (22800, 24) means 22,800 samples and 24 features including the target column. <br/>\n",
    "<br/>\n",
    "- **Missing Values :**  When there are missing values in the original data this will show as True. For this experiment there are no missing values in the dataset. \n",
    "<br/>\n",
    "<br/>\n",
    "- **Numeric Features :**  The number of features inferred as numeric. In this dataset, 14 out of 24 features are inferred as numeric. <br/>\n",
    "<br/>\n",
    "- **Categorical Features :**  The number of features inferred as categorical. In this dataset, 9 out of 24 features are inferred as categorical. <br/>\n",
    "<br/>\n",
    "- **Transformed Train Set :**  Displays the shape of the transformed training set. Notice that the original shape of (22800, 24) is transformed into (15959, 91) for the transformed train set and the number of features have increased to 91 from 24 due to categorical encoding <br/>\n",
    "<br/>\n",
    "- **Transformed Test Set :**  Displays the shape of the transformed test/hold-out set. There are 6841 samples in test/hold-out set. This split is based on the default value of 70/30 that can be changed using the `train_size` parameter in setup. <br/>\n",
    "\n",
    "Notice how a few tasks that are imperative to perform modeling are automatically handled such as missing value imputation (in this case there are no missing values in the training data, but we still need imputers for unseen data), categorical encoding etc. Most of the parameters in `setup()` are optional and used for customizing the pre-processing pipeline. These parameters are out of scope for this tutorial but as you progress to the intermediate and expert levels, we will cover them in much greater detail."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "it_nJo1IEQob"
   },
   "source": [
    "# 7.0 Comparing All Models"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "apb_B9bBEQof"
   },
   "source": [
    "Comparing all models to evaluate performance is the recommended starting point for modeling once the setup is completed (unless you exactly know what kind of model you need, which is often not the case). This function trains all models in the model library and scores them using stratified cross validation for metric evaluation. The output prints a score grid that shows average Accuracy, AUC, Recall, Precision, F1, Kappa, and MCC accross the folds (10 by default) along with training times."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "AsG0b1NIEQoj",
    "outputId": "a6e3a510-45a1-4782-8ffe-0ec138a64eed",
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "    #T_72ad9624_e60d_11ea_b655_482ae32b83da th {\n",
       "          text-align: left;\n",
       "    }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col0 {\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col1 {\n",
       "            background-color:  yellow;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col2 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col3 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col4 {\n",
       "            background-color:  yellow;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col5 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col6 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col7 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col8 {\n",
       "            background-color:  lightgrey;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col0 {\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col1 {\n",
       "            background-color:  yellow;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col2 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col3 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col4 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col5 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col6 {\n",
       "            background-color:  yellow;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col7 {\n",
       "            background-color:  yellow;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col8 {\n",
       "            background-color:  lightgrey;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col0 {\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col1 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col2 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col3 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col4 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col5 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col6 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col7 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col8 {\n",
       "            background-color:  lightgrey;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col0 {\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col1 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col2 {\n",
       "            background-color:  yellow;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col3 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col4 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col5 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col6 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col7 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col8 {\n",
       "            background-color:  lightgrey;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col0 {\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col1 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col2 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col3 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col4 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col5 {\n",
       "            background-color:  yellow;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col6 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col7 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col8 {\n",
       "            background-color:  lightgrey;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col0 {\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col1 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col2 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col3 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col4 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col5 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col6 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col7 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col8 {\n",
       "            background-color:  lightgrey;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col0 {\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col1 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col2 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col3 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col4 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col5 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col6 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col7 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col8 {\n",
       "            background-color:  lightgrey;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col0 {\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col1 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col2 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col3 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col4 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col5 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col6 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col7 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col8 {\n",
       "            background-color:  lightgrey;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col0 {\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col1 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col2 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col3 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col4 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col5 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col6 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col7 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col8 {\n",
       "            background-color:  lightgrey;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col0 {\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col1 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col2 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col3 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col4 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col5 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col6 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col7 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col8 {\n",
       "            background-color:  lightgrey;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col0 {\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col1 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col2 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col3 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col4 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col5 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col6 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col7 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col8 {\n",
       "            background-color:  lightgrey;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col0 {\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col1 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col2 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col3 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col4 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col5 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col6 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col7 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col8 {\n",
       "            background-color:  lightgrey;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col0 {\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col1 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col2 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col3 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col4 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col5 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col6 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col7 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col8 {\n",
       "            background-color:  lightgrey;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col0 {\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col1 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col2 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col3 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col4 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col5 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col6 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col7 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col8 {\n",
       "            background-color:  lightgrey;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col0 {\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col1 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col2 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col3 {\n",
       "            background-color:  yellow;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col4 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col5 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col6 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col7 {\n",
       "            : ;\n",
       "            text-align:  left;\n",
       "        }    #T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col8 {\n",
       "            background-color:  lightgrey;\n",
       "            text-align:  left;\n",
       "        }</style><table id=\"T_72ad9624_e60d_11ea_b655_482ae32b83da\" ><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >Model</th>        <th class=\"col_heading level0 col1\" >Accuracy</th>        <th class=\"col_heading level0 col2\" >AUC</th>        <th class=\"col_heading level0 col3\" >Recall</th>        <th class=\"col_heading level0 col4\" >Prec.</th>        <th class=\"col_heading level0 col5\" >F1</th>        <th class=\"col_heading level0 col6\" >Kappa</th>        <th class=\"col_heading level0 col7\" >MCC</th>        <th class=\"col_heading level0 col8\" >TT (Sec)</th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_72ad9624_e60d_11ea_b655_482ae32b83dalevel0_row0\" class=\"row_heading level0 row0\" >0</th>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col0\" class=\"data row0 col0\" >Ridge Classifier</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col1\" class=\"data row0 col1\" >0.8236</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col2\" class=\"data row0 col2\" >0.0000</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col3\" class=\"data row0 col3\" >0.3646</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col4\" class=\"data row0 col4\" >0.6932</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col5\" class=\"data row0 col5\" >0.4776</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col6\" class=\"data row0 col6\" >0.3836</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col7\" class=\"data row0 col7\" >0.4124</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow0_col8\" class=\"data row0 col8\" >0.0443</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_72ad9624_e60d_11ea_b655_482ae32b83dalevel0_row1\" class=\"row_heading level0 row1\" >1</th>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col0\" class=\"data row1 col0\" >Linear Discriminant Analysis</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col1\" class=\"data row1 col1\" >0.8236</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col2\" class=\"data row1 col2\" >0.7703</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col3\" class=\"data row1 col3\" >0.3813</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col4\" class=\"data row1 col4\" >0.6818</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col5\" class=\"data row1 col5\" >0.4888</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col6\" class=\"data row1 col6\" >0.3923</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col7\" class=\"data row1 col7\" >0.4167</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow1_col8\" class=\"data row1 col8\" >0.3417</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_72ad9624_e60d_11ea_b655_482ae32b83dalevel0_row2\" class=\"row_heading level0 row2\" >2</th>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col0\" class=\"data row2 col0\" >Gradient Boosting Classifier</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col1\" class=\"data row2 col1\" >0.8225</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col2\" class=\"data row2 col2\" >0.7888</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col3\" class=\"data row2 col3\" >0.3652</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col4\" class=\"data row2 col4\" >0.6868</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col5\" class=\"data row2 col5\" >0.4765</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col6\" class=\"data row2 col6\" >0.3815</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col7\" class=\"data row2 col7\" >0.4093</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow2_col8\" class=\"data row2 col8\" >5.7392</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_72ad9624_e60d_11ea_b655_482ae32b83dalevel0_row3\" class=\"row_heading level0 row3\" >3</th>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col0\" class=\"data row3 col0\" >Extreme Gradient Boosting</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col1\" class=\"data row3 col1\" >0.8218</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col2\" class=\"data row3 col2\" >0.7894</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col3\" class=\"data row3 col3\" >0.3595</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col4\" class=\"data row3 col4\" >0.6862</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col5\" class=\"data row3 col5\" >0.4715</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col6\" class=\"data row3 col6\" >0.3767</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col7\" class=\"data row3 col7\" >0.4054</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow3_col8\" class=\"data row3 col8\" >2.0535</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_72ad9624_e60d_11ea_b655_482ae32b83dalevel0_row4\" class=\"row_heading level0 row4\" >4</th>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col0\" class=\"data row4 col0\" >Light Gradient Boosting Machine</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col1\" class=\"data row4 col1\" >0.8214</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col2\" class=\"data row4 col2\" >0.7859</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col3\" class=\"data row4 col3\" >0.3878</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col4\" class=\"data row4 col4\" >0.6663</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col5\" class=\"data row4 col5\" >0.4900</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col6\" class=\"data row4 col6\" >0.3908</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col7\" class=\"data row4 col7\" >0.4120</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow4_col8\" class=\"data row4 col8\" >0.4921</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_72ad9624_e60d_11ea_b655_482ae32b83dalevel0_row5\" class=\"row_heading level0 row5\" >5</th>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col0\" class=\"data row5 col0\" >CatBoost Classifier</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col1\" class=\"data row5 col1\" >0.8212</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col2\" class=\"data row5 col2\" >0.7858</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col3\" class=\"data row5 col3\" >0.3861</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col4\" class=\"data row5 col4\" >0.6653</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col5\" class=\"data row5 col5\" >0.4884</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col6\" class=\"data row5 col6\" >0.3892</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col7\" class=\"data row5 col7\" >0.4105</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow5_col8\" class=\"data row5 col8\" >11.9035</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_72ad9624_e60d_11ea_b655_482ae32b83dalevel0_row6\" class=\"row_heading level0 row6\" >6</th>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col0\" class=\"data row6 col0\" >Ada Boost Classifier</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col1\" class=\"data row6 col1\" >0.8185</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col2\" class=\"data row6 col2\" >0.7783</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col3\" class=\"data row6 col3\" >0.3507</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col4\" class=\"data row6 col4\" >0.6729</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col5\" class=\"data row6 col5\" >0.4607</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col6\" class=\"data row6 col6\" >0.3644</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col7\" class=\"data row6 col7\" >0.3926</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow6_col8\" class=\"data row6 col8\" >1.5654</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_72ad9624_e60d_11ea_b655_482ae32b83dalevel0_row7\" class=\"row_heading level0 row7\" >7</th>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col0\" class=\"data row7 col0\" >Random Forest Classifier</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col1\" class=\"data row7 col1\" >0.8093</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col2\" class=\"data row7 col2\" >0.7401</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col3\" class=\"data row7 col3\" >0.3363</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col4\" class=\"data row7 col4\" >0.6295</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col5\" class=\"data row7 col5\" >0.4382</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col6\" class=\"data row7 col6\" >0.3359</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col7\" class=\"data row7 col7\" >0.3600</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow7_col8\" class=\"data row7 col8\" >0.1166</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_72ad9624_e60d_11ea_b655_482ae32b83dalevel0_row8\" class=\"row_heading level0 row8\" >8</th>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col0\" class=\"data row8 col0\" >Extra Trees Classifier</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col1\" class=\"data row8 col1\" >0.8091</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col2\" class=\"data row8 col2\" >0.7501</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col3\" class=\"data row8 col3\" >0.3841</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col4\" class=\"data row8 col4\" >0.6083</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col5\" class=\"data row8 col5\" >0.4707</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col6\" class=\"data row8 col6\" >0.3615</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col7\" class=\"data row8 col7\" >0.3758</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow8_col8\" class=\"data row8 col8\" >0.9647</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_72ad9624_e60d_11ea_b655_482ae32b83dalevel0_row9\" class=\"row_heading level0 row9\" >9</th>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col0\" class=\"data row9 col0\" >Quadratic Discriminant Analysis</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col1\" class=\"data row9 col1\" >0.7891</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col2\" class=\"data row9 col2\" >0.7392</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col3\" class=\"data row9 col3\" >0.1725</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col4\" class=\"data row9 col4\" >0.6266</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col5\" class=\"data row9 col5\" >0.2368</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col6\" class=\"data row9 col6\" >0.1689</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col7\" class=\"data row9 col7\" >0.2305</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow9_col8\" class=\"data row9 col8\" >0.1047</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_72ad9624_e60d_11ea_b655_482ae32b83dalevel0_row10\" class=\"row_heading level0 row10\" >10</th>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col0\" class=\"data row10 col0\" >Logistic Regression</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col1\" class=\"data row10 col1\" >0.7785</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col2\" class=\"data row10 col2\" >0.6514</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col3\" class=\"data row10 col3\" >0.0008</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col4\" class=\"data row10 col4\" >0.1083</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col5\" class=\"data row10 col5\" >0.0017</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col6\" class=\"data row10 col6\" >0.0003</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col7\" class=\"data row10 col7\" >0.0012</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow10_col8\" class=\"data row10 col8\" >0.2889</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_72ad9624_e60d_11ea_b655_482ae32b83dalevel0_row11\" class=\"row_heading level0 row11\" >11</th>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col0\" class=\"data row11 col0\" >K Neighbors Classifier</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col1\" class=\"data row11 col1\" >0.7505</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col2\" class=\"data row11 col2\" >0.6097</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col3\" class=\"data row11 col3\" >0.1802</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col4\" class=\"data row11 col4\" >0.3694</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col5\" class=\"data row11 col5\" >0.2421</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col6\" class=\"data row11 col6\" >0.1134</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col7\" class=\"data row11 col7\" >0.1240</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow11_col8\" class=\"data row11 col8\" >0.3470</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_72ad9624_e60d_11ea_b655_482ae32b83dalevel0_row12\" class=\"row_heading level0 row12\" >12</th>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col0\" class=\"data row12 col0\" >Decision Tree Classifier</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col1\" class=\"data row12 col1\" >0.7301</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col2\" class=\"data row12 col2\" >0.6211</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col3\" class=\"data row12 col3\" >0.4244</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col4\" class=\"data row12 col4\" >0.3973</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col5\" class=\"data row12 col5\" >0.4101</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col6\" class=\"data row12 col6\" >0.2355</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col7\" class=\"data row12 col7\" >0.2359</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow12_col8\" class=\"data row12 col8\" >0.3418</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_72ad9624_e60d_11ea_b655_482ae32b83dalevel0_row13\" class=\"row_heading level0 row13\" >13</th>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col0\" class=\"data row13 col0\" >SVM - Linear Kernel</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col1\" class=\"data row13 col1\" >0.7234</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col2\" class=\"data row13 col2\" >0.0000</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col3\" class=\"data row13 col3\" >0.1014</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col4\" class=\"data row13 col4\" >0.1252</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col5\" class=\"data row13 col5\" >0.0409</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col6\" class=\"data row13 col6\" >0.0001</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col7\" class=\"data row13 col7\" >0.0046</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow13_col8\" class=\"data row13 col8\" >0.4645</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_72ad9624_e60d_11ea_b655_482ae32b83dalevel0_row14\" class=\"row_heading level0 row14\" >14</th>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col0\" class=\"data row14 col0\" >Naive Bayes</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col1\" class=\"data row14 col1\" >0.3651</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col2\" class=\"data row14 col2\" >0.6458</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col3\" class=\"data row14 col3\" >0.9020</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col4\" class=\"data row14 col4\" >0.2455</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col5\" class=\"data row14 col5\" >0.3859</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col6\" class=\"data row14 col6\" >0.0585</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col7\" class=\"data row14 col7\" >0.1224</td>\n",
       "                        <td id=\"T_72ad9624_e60d_11ea_b655_482ae32b83darow14_col8\" class=\"data row14 col8\" >0.0374</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x1a14ca06c08>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "best_model = compare_models()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "nZAUhQGLEQoz"
   },
   "source": [
    "Two simple words of code ***(not even a line)*** have trained and evaluated over 15 models using cross validation. The score grid printed above highlights the highest performing metric for comparison purposes only. The grid by default is sorted using 'Accuracy' (highest to lowest) which can be changed by passing the `sort` parameter. For example `compare_models(sort = 'Recall')` will sort the grid by Recall instead of Accuracy. If you want to change the fold parameter from the default value of `10` to a different value then you can use the `fold` parameter. For example `compare_models(fold = 5)` will compare all models on 5 fold cross validation. Reducing the number of folds will improve the training time. By default, `compare_models` return the best performing model based on default sort order but can be used to return a list of top N models by using `n_select` parameter."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "RidgeClassifier(alpha=1.0, class_weight=None, copy_X=True, fit_intercept=True,\n",
      "                max_iter=None, normalize=False, random_state=123, solver='auto',\n",
      "                tol=0.001)\n"
     ]
    }
   ],
   "source": [
    "print(best_model)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "P5m2pciOEQo4"
   },
   "source": [
    "# 8.0 Create a Model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "u_6cIilfEQo7"
   },
   "source": [
    "`create_model` is the most granular function in PyCaret and is often the foundation behind most of the PyCaret functionalities. As the name suggests this function trains and evaluates a model using cross validation that can be set with `fold` parameter. The output prints a score grid that shows Accuracy, AUC, Recall, Precision, F1, Kappa and MCC by fold. \n",
    "\n",
    "For the remaining part of this tutorial, we will work with the below models as our candidate models. The selections are for illustration purposes only and do not necessarily mean they are the top performing or ideal for this type of data.\n",
    "\n",
    "- Decision Tree Classifier ('dt')\n",
    "- K Neighbors Classifier ('knn')\n",
    "- Random Forest Classifier ('rf')\n",
    "\n",
    "There are 18 classifiers available in the model library of PyCaret. To see list of all classifiers either check the `docstring` or use `models` function to see the library."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Name</th>\n",
       "      <th>Reference</th>\n",
       "      <th>Turbo</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ID</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>lr</th>\n",
       "      <td>Logistic Regression</td>\n",
       "      <td>sklearn.linear_model.LogisticRegression</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>knn</th>\n",
       "      <td>K Neighbors Classifier</td>\n",
       "      <td>sklearn.neighbors.KNeighborsClassifier</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>nb</th>\n",
       "      <td>Naive Bayes</td>\n",
       "      <td>sklearn.naive_bayes.GaussianNB</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>dt</th>\n",
       "      <td>Decision Tree Classifier</td>\n",
       "      <td>sklearn.tree.DecisionTreeClassifier</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>svm</th>\n",
       "      <td>SVM - Linear Kernel</td>\n",
       "      <td>sklearn.linear_model.SGDClassifier</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>rbfsvm</th>\n",
       "      <td>SVM - Radial Kernel</td>\n",
       "      <td>sklearn.svm.SVC</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>gpc</th>\n",
       "      <td>Gaussian Process Classifier</td>\n",
       "      <td>sklearn.gaussian_process.GPC</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>mlp</th>\n",
       "      <td>MLP Classifier</td>\n",
       "      <td>sklearn.neural_network.MLPClassifier</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ridge</th>\n",
       "      <td>Ridge Classifier</td>\n",
       "      <td>sklearn.linear_model.RidgeClassifier</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>rf</th>\n",
       "      <td>Random Forest Classifier</td>\n",
       "      <td>sklearn.ensemble.RandomForestClassifier</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>qda</th>\n",
       "      <td>Quadratic Discriminant Analysis</td>\n",
       "      <td>sklearn.discriminant_analysis.QDA</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ada</th>\n",
       "      <td>Ada Boost Classifier</td>\n",
       "      <td>sklearn.ensemble.AdaBoostClassifier</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>gbc</th>\n",
       "      <td>Gradient Boosting Classifier</td>\n",
       "      <td>sklearn.ensemble.GradientBoostingClassifier</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>lda</th>\n",
       "      <td>Linear Discriminant Analysis</td>\n",
       "      <td>sklearn.discriminant_analysis.LDA</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>et</th>\n",
       "      <td>Extra Trees Classifier</td>\n",
       "      <td>sklearn.ensemble.ExtraTreesClassifier</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>xgboost</th>\n",
       "      <td>Extreme Gradient Boosting</td>\n",
       "      <td>xgboost.readthedocs.io</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>lightgbm</th>\n",
       "      <td>Light Gradient Boosting Machine</td>\n",
       "      <td>github.com/microsoft/LightGBM</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>catboost</th>\n",
       "      <td>CatBoost Classifier</td>\n",
       "      <td>catboost.ai</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                     Name  \\\n",
       "ID                                          \n",
       "lr                    Logistic Regression   \n",
       "knn                K Neighbors Classifier   \n",
       "nb                            Naive Bayes   \n",
       "dt               Decision Tree Classifier   \n",
       "svm                   SVM - Linear Kernel   \n",
       "rbfsvm                SVM - Radial Kernel   \n",
       "gpc           Gaussian Process Classifier   \n",
       "mlp                        MLP Classifier   \n",
       "ridge                    Ridge Classifier   \n",
       "rf               Random Forest Classifier   \n",
       "qda       Quadratic Discriminant Analysis   \n",
       "ada                  Ada Boost Classifier   \n",
       "gbc          Gradient Boosting Classifier   \n",
       "lda          Linear Discriminant Analysis   \n",
       "et                 Extra Trees Classifier   \n",
       "xgboost         Extreme Gradient Boosting   \n",
       "lightgbm  Light Gradient Boosting Machine   \n",
       "catboost              CatBoost Classifier   \n",
       "\n",
       "                                            Reference  Turbo  \n",
       "ID                                                            \n",
       "lr            sklearn.linear_model.LogisticRegression   True  \n",
       "knn            sklearn.neighbors.KNeighborsClassifier   True  \n",
       "nb                     sklearn.naive_bayes.GaussianNB   True  \n",
       "dt                sklearn.tree.DecisionTreeClassifier   True  \n",
       "svm                sklearn.linear_model.SGDClassifier   True  \n",
       "rbfsvm                                sklearn.svm.SVC  False  \n",
       "gpc                      sklearn.gaussian_process.GPC  False  \n",
       "mlp              sklearn.neural_network.MLPClassifier  False  \n",
       "ridge            sklearn.linear_model.RidgeClassifier   True  \n",
       "rf            sklearn.ensemble.RandomForestClassifier   True  \n",
       "qda                 sklearn.discriminant_analysis.QDA   True  \n",
       "ada               sklearn.ensemble.AdaBoostClassifier   True  \n",
       "gbc       sklearn.ensemble.GradientBoostingClassifier   True  \n",
       "lda                 sklearn.discriminant_analysis.LDA   True  \n",
       "et              sklearn.ensemble.ExtraTreesClassifier   True  \n",
       "xgboost                        xgboost.readthedocs.io   True  \n",
       "lightgbm                github.com/microsoft/LightGBM   True  \n",
       "catboost                                  catboost.ai   True  "
      ]
     },
     "execution_count": 40,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "models()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "UWMSeyNhEQo-"
   },
   "source": [
    "### 8.1 Decision Tree Classifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 392
    },
    "colab_type": "code",
    "id": "LP896uSIEQpD",
    "outputId": "d6d31562-feb5-4052-ee23-0a444fecaacf"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "    #T_12c3c1f6_e614_11ea_b13a_482ae32b83darow10_col0 {\n",
       "            background:  yellow;\n",
       "        }    #T_12c3c1f6_e614_11ea_b13a_482ae32b83darow10_col1 {\n",
       "            background:  yellow;\n",
       "        }    #T_12c3c1f6_e614_11ea_b13a_482ae32b83darow10_col2 {\n",
       "            background:  yellow;\n",
       "        }    #T_12c3c1f6_e614_11ea_b13a_482ae32b83darow10_col3 {\n",
       "            background:  yellow;\n",
       "        }    #T_12c3c1f6_e614_11ea_b13a_482ae32b83darow10_col4 {\n",
       "            background:  yellow;\n",
       "        }    #T_12c3c1f6_e614_11ea_b13a_482ae32b83darow10_col5 {\n",
       "            background:  yellow;\n",
       "        }    #T_12c3c1f6_e614_11ea_b13a_482ae32b83darow10_col6 {\n",
       "            background:  yellow;\n",
       "        }</style><table id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83da\" ><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >Accuracy</th>        <th class=\"col_heading level0 col1\" >AUC</th>        <th class=\"col_heading level0 col2\" >Recall</th>        <th class=\"col_heading level0 col3\" >Prec.</th>        <th class=\"col_heading level0 col4\" >F1</th>        <th class=\"col_heading level0 col5\" >Kappa</th>        <th class=\"col_heading level0 col6\" >MCC</th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83dalevel0_row0\" class=\"row_heading level0 row0\" >0</th>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow0_col0\" class=\"data row0 col0\" >0.7224</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow0_col1\" class=\"data row0 col1\" >0.6109</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow0_col2\" class=\"data row0 col2\" >0.4108</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow0_col3\" class=\"data row0 col3\" >0.3816</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow0_col4\" class=\"data row0 col4\" >0.3956</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow0_col5\" class=\"data row0 col5\" >0.2158</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow0_col6\" class=\"data row0 col6\" >0.2160</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83dalevel0_row1\" class=\"row_heading level0 row1\" >1</th>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow1_col0\" class=\"data row1 col0\" >0.7199</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow1_col1\" class=\"data row1 col1\" >0.6225</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow1_col2\" class=\"data row1 col2\" >0.4448</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow1_col3\" class=\"data row1 col3\" >0.3848</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow1_col4\" class=\"data row1 col4\" >0.4126</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow1_col5\" class=\"data row1 col5\" >0.2300</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow1_col6\" class=\"data row1 col6\" >0.2310</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83dalevel0_row2\" class=\"row_heading level0 row2\" >2</th>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow2_col0\" class=\"data row2 col0\" >0.7400</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow2_col1\" class=\"data row2 col1\" >0.6310</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow2_col2\" class=\"data row2 col2\" >0.4363</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow2_col3\" class=\"data row2 col3\" >0.4162</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow2_col4\" class=\"data row2 col4\" >0.4260</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow2_col5\" class=\"data row2 col5\" >0.2580</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow2_col6\" class=\"data row2 col6\" >0.2582</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83dalevel0_row3\" class=\"row_heading level0 row3\" >3</th>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow3_col0\" class=\"data row3 col0\" >0.7262</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow3_col1\" class=\"data row3 col1\" >0.6094</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow3_col2\" class=\"data row3 col2\" >0.3966</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow3_col3\" class=\"data row3 col3\" >0.3846</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow3_col4\" class=\"data row3 col4\" >0.3905</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow3_col5\" class=\"data row3 col5\" >0.2140</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow3_col6\" class=\"data row3 col6\" >0.2140</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83dalevel0_row4\" class=\"row_heading level0 row4\" >4</th>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow4_col0\" class=\"data row4 col0\" >0.7306</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow4_col1\" class=\"data row4 col1\" >0.6090</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow4_col2\" class=\"data row4 col2\" >0.3909</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow4_col3\" class=\"data row4 col3\" >0.3909</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow4_col4\" class=\"data row4 col4\" >0.3909</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow4_col5\" class=\"data row4 col5\" >0.2180</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow4_col6\" class=\"data row4 col6\" >0.2180</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83dalevel0_row5\" class=\"row_heading level0 row5\" >5</th>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow5_col0\" class=\"data row5 col0\" >0.7331</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow5_col1\" class=\"data row5 col1\" >0.6381</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow5_col2\" class=\"data row5 col2\" >0.4646</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow5_col3\" class=\"data row5 col3\" >0.4090</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow5_col4\" class=\"data row5 col4\" >0.4350</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow5_col5\" class=\"data row5 col5\" >0.2612</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow5_col6\" class=\"data row5 col6\" >0.2621</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83dalevel0_row6\" class=\"row_heading level0 row6\" >6</th>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow6_col0\" class=\"data row6 col0\" >0.7155</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow6_col1\" class=\"data row6 col1\" >0.6137</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow6_col2\" class=\"data row6 col2\" >0.4306</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow6_col3\" class=\"data row6 col3\" >0.3753</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow6_col4\" class=\"data row6 col4\" >0.4011</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow6_col5\" class=\"data row6 col5\" >0.2157</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow6_col6\" class=\"data row6 col6\" >0.2166</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83dalevel0_row7\" class=\"row_heading level0 row7\" >7</th>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow7_col0\" class=\"data row7 col0\" >0.7462</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow7_col1\" class=\"data row7 col1\" >0.6363</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow7_col2\" class=\"data row7 col2\" >0.4391</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow7_col3\" class=\"data row7 col3\" >0.4282</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow7_col4\" class=\"data row7 col4\" >0.4336</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow7_col5\" class=\"data row7 col5\" >0.2701</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow7_col6\" class=\"data row7 col6\" >0.2701</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83dalevel0_row8\" class=\"row_heading level0 row8\" >8</th>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow8_col0\" class=\"data row8 col0\" >0.7318</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow8_col1\" class=\"data row8 col1\" >0.6209</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow8_col2\" class=\"data row8 col2\" >0.4221</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow8_col3\" class=\"data row8 col3\" >0.3995</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow8_col4\" class=\"data row8 col4\" >0.4105</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow8_col5\" class=\"data row8 col5\" >0.2371</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow8_col6\" class=\"data row8 col6\" >0.2372</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83dalevel0_row9\" class=\"row_heading level0 row9\" >9</th>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow9_col0\" class=\"data row9 col0\" >0.7354</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow9_col1\" class=\"data row9 col1\" >0.6194</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow9_col2\" class=\"data row9 col2\" >0.4079</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow9_col3\" class=\"data row9 col3\" >0.4034</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow9_col4\" class=\"data row9 col4\" >0.4056</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow9_col5\" class=\"data row9 col5\" >0.2355</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow9_col6\" class=\"data row9 col6\" >0.2355</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83dalevel0_row10\" class=\"row_heading level0 row10\" >Mean</th>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow10_col0\" class=\"data row10 col0\" >0.7301</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow10_col1\" class=\"data row10 col1\" >0.6211</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow10_col2\" class=\"data row10 col2\" >0.4244</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow10_col3\" class=\"data row10 col3\" >0.3973</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow10_col4\" class=\"data row10 col4\" >0.4101</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow10_col5\" class=\"data row10 col5\" >0.2355</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow10_col6\" class=\"data row10 col6\" >0.2359</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83dalevel0_row11\" class=\"row_heading level0 row11\" >SD</th>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow11_col0\" class=\"data row11 col0\" >0.0089</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow11_col1\" class=\"data row11 col1\" >0.0103</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow11_col2\" class=\"data row11 col2\" >0.0219</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow11_col3\" class=\"data row11 col3\" >0.0161</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow11_col4\" class=\"data row11 col4\" >0.0158</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow11_col5\" class=\"data row11 col5\" >0.0199</td>\n",
       "                        <td id=\"T_12c3c1f6_e614_11ea_b13a_482ae32b83darow11_col6\" class=\"data row11 col6\" >0.0199</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x1a14c8c9b88>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "dt = create_model('dt')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "FRat05yGEQpQ",
    "outputId": "c8e6a190-8bec-4646-d2c8-8a92b129c484"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "DecisionTreeClassifier(ccp_alpha=0.0, class_weight=None, criterion='gini',\n",
      "                       max_depth=None, max_features=None, max_leaf_nodes=None,\n",
      "                       min_impurity_decrease=0.0, min_impurity_split=None,\n",
      "                       min_samples_leaf=1, min_samples_split=2,\n",
      "                       min_weight_fraction_leaf=0.0, presort='deprecated',\n",
      "                       random_state=123, splitter='best')\n"
     ]
    }
   ],
   "source": [
    "#trained model object is stored in the variable 'dt'. \n",
    "print(dt)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "rWUojqBCEQpb"
   },
   "source": [
    "### 8.2 K Neighbors Classifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 392
    },
    "colab_type": "code",
    "id": "2uonD20gEQpe",
    "outputId": "560e3cb6-41d5-4293-b1c5-2bd1cf3bc63b"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "    #T_16a846ba_e614_11ea_a6ae_482ae32b83darow10_col0 {\n",
       "            background:  yellow;\n",
       "        }    #T_16a846ba_e614_11ea_a6ae_482ae32b83darow10_col1 {\n",
       "            background:  yellow;\n",
       "        }    #T_16a846ba_e614_11ea_a6ae_482ae32b83darow10_col2 {\n",
       "            background:  yellow;\n",
       "        }    #T_16a846ba_e614_11ea_a6ae_482ae32b83darow10_col3 {\n",
       "            background:  yellow;\n",
       "        }    #T_16a846ba_e614_11ea_a6ae_482ae32b83darow10_col4 {\n",
       "            background:  yellow;\n",
       "        }    #T_16a846ba_e614_11ea_a6ae_482ae32b83darow10_col5 {\n",
       "            background:  yellow;\n",
       "        }    #T_16a846ba_e614_11ea_a6ae_482ae32b83darow10_col6 {\n",
       "            background:  yellow;\n",
       "        }</style><table id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83da\" ><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >Accuracy</th>        <th class=\"col_heading level0 col1\" >AUC</th>        <th class=\"col_heading level0 col2\" >Recall</th>        <th class=\"col_heading level0 col3\" >Prec.</th>        <th class=\"col_heading level0 col4\" >F1</th>        <th class=\"col_heading level0 col5\" >Kappa</th>        <th class=\"col_heading level0 col6\" >MCC</th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83dalevel0_row0\" class=\"row_heading level0 row0\" >0</th>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow0_col0\" class=\"data row0 col0\" >0.7412</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow0_col1\" class=\"data row0 col1\" >0.5881</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow0_col2\" class=\"data row0 col2\" >0.1671</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow0_col3\" class=\"data row0 col3\" >0.3315</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow0_col4\" class=\"data row0 col4\" >0.2222</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow0_col5\" class=\"data row0 col5\" >0.0868</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow0_col6\" class=\"data row0 col6\" >0.0941</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83dalevel0_row1\" class=\"row_heading level0 row1\" >1</th>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow1_col0\" class=\"data row1 col0\" >0.7350</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow1_col1\" class=\"data row1 col1\" >0.5787</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow1_col2\" class=\"data row1 col2\" >0.1473</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow1_col3\" class=\"data row1 col3\" >0.2989</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow1_col4\" class=\"data row1 col4\" >0.1973</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow1_col5\" class=\"data row1 col5\" >0.0601</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow1_col6\" class=\"data row1 col6\" >0.0655</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83dalevel0_row2\" class=\"row_heading level0 row2\" >2</th>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow2_col0\" class=\"data row2 col0\" >0.7632</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow2_col1\" class=\"data row2 col1\" >0.6641</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow2_col2\" class=\"data row2 col2\" >0.2096</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow2_col3\" class=\"data row2 col3\" >0.4277</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow2_col4\" class=\"data row2 col4\" >0.2814</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow2_col5\" class=\"data row2 col5\" >0.1590</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow2_col6\" class=\"data row2 col6\" >0.1735</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83dalevel0_row3\" class=\"row_heading level0 row3\" >3</th>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow3_col0\" class=\"data row3 col0\" >0.7462</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow3_col1\" class=\"data row3 col1\" >0.5982</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow3_col2\" class=\"data row3 col2\" >0.1530</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow3_col3\" class=\"data row3 col3\" >0.3375</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow3_col4\" class=\"data row3 col4\" >0.2105</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow3_col5\" class=\"data row3 col5\" >0.0842</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow3_col6\" class=\"data row3 col6\" >0.0936</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83dalevel0_row4\" class=\"row_heading level0 row4\" >4</th>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow4_col0\" class=\"data row4 col0\" >0.7550</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow4_col1\" class=\"data row4 col1\" >0.6096</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow4_col2\" class=\"data row4 col2\" >0.2040</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow4_col3\" class=\"data row4 col3\" >0.3956</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow4_col4\" class=\"data row4 col4\" >0.2692</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow4_col5\" class=\"data row4 col5\" >0.1397</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow4_col6\" class=\"data row4 col6\" >0.1508</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83dalevel0_row5\" class=\"row_heading level0 row5\" >5</th>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow5_col0\" class=\"data row5 col0\" >0.7607</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow5_col1\" class=\"data row5 col1\" >0.6200</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow5_col2\" class=\"data row5 col2\" >0.1841</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow5_col3\" class=\"data row5 col3\" >0.4088</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow5_col4\" class=\"data row5 col4\" >0.2539</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow5_col5\" class=\"data row5 col5\" >0.1351</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow5_col6\" class=\"data row5 col6\" >0.1504</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83dalevel0_row6\" class=\"row_heading level0 row6\" >6</th>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow6_col0\" class=\"data row6 col0\" >0.7406</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow6_col1\" class=\"data row6 col1\" >0.5884</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow6_col2\" class=\"data row6 col2\" >0.1700</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow6_col3\" class=\"data row6 col3\" >0.3315</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow6_col4\" class=\"data row6 col4\" >0.2247</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow6_col5\" class=\"data row6 col5\" >0.0880</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow6_col6\" class=\"data row6 col6\" >0.0951</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83dalevel0_row7\" class=\"row_heading level0 row7\" >7</th>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow7_col0\" class=\"data row7 col0\" >0.7600</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow7_col1\" class=\"data row7 col1\" >0.6139</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow7_col2\" class=\"data row7 col2\" >0.1898</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow7_col3\" class=\"data row7 col3\" >0.4085</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow7_col4\" class=\"data row7 col4\" >0.2592</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow7_col5\" class=\"data row7 col5\" >0.1383</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow7_col6\" class=\"data row7 col6\" >0.1528</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83dalevel0_row8\" class=\"row_heading level0 row8\" >8</th>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow8_col0\" class=\"data row8 col0\" >0.7487</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow8_col1\" class=\"data row8 col1\" >0.6106</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow8_col2\" class=\"data row8 col2\" >0.1898</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow8_col3\" class=\"data row8 col3\" >0.3681</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow8_col4\" class=\"data row8 col4\" >0.2505</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow8_col5\" class=\"data row8 col5\" >0.1177</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow8_col6\" class=\"data row8 col6\" >0.1270</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83dalevel0_row9\" class=\"row_heading level0 row9\" >9</th>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow9_col0\" class=\"data row9 col0\" >0.7542</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow9_col1\" class=\"data row9 col1\" >0.6254</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow9_col2\" class=\"data row9 col2\" >0.1870</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow9_col3\" class=\"data row9 col3\" >0.3860</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow9_col4\" class=\"data row9 col4\" >0.2519</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow9_col5\" class=\"data row9 col5\" >0.1256</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow9_col6\" class=\"data row9 col6\" >0.1374</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83dalevel0_row10\" class=\"row_heading level0 row10\" >Mean</th>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow10_col0\" class=\"data row10 col0\" >0.7505</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow10_col1\" class=\"data row10 col1\" >0.6097</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow10_col2\" class=\"data row10 col2\" >0.1802</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow10_col3\" class=\"data row10 col3\" >0.3694</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow10_col4\" class=\"data row10 col4\" >0.2421</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow10_col5\" class=\"data row10 col5\" >0.1134</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow10_col6\" class=\"data row10 col6\" >0.1240</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83dalevel0_row11\" class=\"row_heading level0 row11\" >SD</th>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow11_col0\" class=\"data row11 col0\" >0.0091</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow11_col1\" class=\"data row11 col1\" >0.0231</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow11_col2\" class=\"data row11 col2\" >0.0194</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow11_col3\" class=\"data row11 col3\" >0.0404</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow11_col4\" class=\"data row11 col4\" >0.0256</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow11_col5\" class=\"data row11 col5\" >0.0301</td>\n",
       "                        <td id=\"T_16a846ba_e614_11ea_a6ae_482ae32b83darow11_col6\" class=\"data row11 col6\" >0.0331</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x1a14ca06088>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "knn = create_model('knn')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "nSg3OUjuEQpu"
   },
   "source": [
    "### 8.3 Random Forest Classifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 392
    },
    "colab_type": "code",
    "id": "FGCoUiQpEQpz",
    "outputId": "212cb736-6dcb-4b77-e45b-14ad895bff43"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "    #T_1926a2cc_e614_11ea_ac48_482ae32b83darow10_col0 {\n",
       "            background:  yellow;\n",
       "        }    #T_1926a2cc_e614_11ea_ac48_482ae32b83darow10_col1 {\n",
       "            background:  yellow;\n",
       "        }    #T_1926a2cc_e614_11ea_ac48_482ae32b83darow10_col2 {\n",
       "            background:  yellow;\n",
       "        }    #T_1926a2cc_e614_11ea_ac48_482ae32b83darow10_col3 {\n",
       "            background:  yellow;\n",
       "        }    #T_1926a2cc_e614_11ea_ac48_482ae32b83darow10_col4 {\n",
       "            background:  yellow;\n",
       "        }    #T_1926a2cc_e614_11ea_ac48_482ae32b83darow10_col5 {\n",
       "            background:  yellow;\n",
       "        }    #T_1926a2cc_e614_11ea_ac48_482ae32b83darow10_col6 {\n",
       "            background:  yellow;\n",
       "        }</style><table id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83da\" ><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >Accuracy</th>        <th class=\"col_heading level0 col1\" >AUC</th>        <th class=\"col_heading level0 col2\" >Recall</th>        <th class=\"col_heading level0 col3\" >Prec.</th>        <th class=\"col_heading level0 col4\" >F1</th>        <th class=\"col_heading level0 col5\" >Kappa</th>        <th class=\"col_heading level0 col6\" >MCC</th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83dalevel0_row0\" class=\"row_heading level0 row0\" >0</th>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow0_col0\" class=\"data row0 col0\" >0.8095</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow0_col1\" class=\"data row0 col1\" >0.7531</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow0_col2\" class=\"data row0 col2\" >0.3428</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow0_col3\" class=\"data row0 col3\" >0.6269</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow0_col4\" class=\"data row0 col4\" >0.4432</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow0_col5\" class=\"data row0 col5\" >0.3400</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow0_col6\" class=\"data row0 col6\" >0.3626</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83dalevel0_row1\" class=\"row_heading level0 row1\" >1</th>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow1_col0\" class=\"data row1 col0\" >0.8127</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow1_col1\" class=\"data row1 col1\" >0.7451</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow1_col2\" class=\"data row1 col2\" >0.3399</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow1_col3\" class=\"data row1 col3\" >0.6452</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow1_col4\" class=\"data row1 col4\" >0.4453</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow1_col5\" class=\"data row1 col5\" >0.3453</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow1_col6\" class=\"data row1 col6\" >0.3710</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83dalevel0_row2\" class=\"row_heading level0 row2\" >2</th>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow2_col0\" class=\"data row2 col0\" >0.8076</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow2_col1\" class=\"data row2 col1\" >0.7714</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow2_col2\" class=\"data row2 col2\" >0.3258</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow2_col3\" class=\"data row2 col3\" >0.6250</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow2_col4\" class=\"data row2 col4\" >0.4283</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow2_col5\" class=\"data row2 col5\" >0.3262</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow2_col6\" class=\"data row2 col6\" >0.3512</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83dalevel0_row3\" class=\"row_heading level0 row3\" >3</th>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow3_col0\" class=\"data row3 col0\" >0.7989</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow3_col1\" class=\"data row3 col1\" >0.7185</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow3_col2\" class=\"data row3 col2\" >0.3144</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow3_col3\" class=\"data row3 col3\" >0.5842</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow3_col4\" class=\"data row3 col4\" >0.4088</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow3_col5\" class=\"data row3 col5\" >0.3006</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow3_col6\" class=\"data row3 col6\" >0.3215</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83dalevel0_row4\" class=\"row_heading level0 row4\" >4</th>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow4_col0\" class=\"data row4 col0\" >0.8051</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow4_col1\" class=\"data row4 col1\" >0.7249</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow4_col2\" class=\"data row4 col2\" >0.3229</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow4_col3\" class=\"data row4 col3\" >0.6129</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow4_col4\" class=\"data row4 col4\" >0.4230</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow4_col5\" class=\"data row4 col5\" >0.3191</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow4_col6\" class=\"data row4 col6\" >0.3428</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83dalevel0_row5\" class=\"row_heading level0 row5\" >5</th>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow5_col0\" class=\"data row5 col0\" >0.8152</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow5_col1\" class=\"data row5 col1\" >0.7324</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow5_col2\" class=\"data row5 col2\" >0.3569</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow5_col3\" class=\"data row5 col3\" >0.6495</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow5_col4\" class=\"data row5 col4\" >0.4607</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow5_col5\" class=\"data row5 col5\" >0.3603</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow5_col6\" class=\"data row5 col6\" >0.3839</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83dalevel0_row6\" class=\"row_heading level0 row6\" >6</th>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow6_col0\" class=\"data row6 col0\" >0.8039</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow6_col1\" class=\"data row6 col1\" >0.7244</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow6_col2\" class=\"data row6 col2\" >0.3371</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow6_col3\" class=\"data row6 col3\" >0.6010</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow6_col4\" class=\"data row6 col4\" >0.4319</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow6_col5\" class=\"data row6 col5\" >0.3246</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow6_col6\" class=\"data row6 col6\" >0.3444</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83dalevel0_row7\" class=\"row_heading level0 row7\" >7</th>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow7_col0\" class=\"data row7 col0\" >0.8158</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow7_col1\" class=\"data row7 col1\" >0.7711</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow7_col2\" class=\"data row7 col2\" >0.3399</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow7_col3\" class=\"data row7 col3\" >0.6630</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow7_col4\" class=\"data row7 col4\" >0.4494</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow7_col5\" class=\"data row7 col5\" >0.3523</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow7_col6\" class=\"data row7 col6\" >0.3807</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83dalevel0_row8\" class=\"row_heading level0 row8\" >8</th>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow8_col0\" class=\"data row8 col0\" >0.8139</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow8_col1\" class=\"data row8 col1\" >0.7183</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow8_col2\" class=\"data row8 col2\" >0.3258</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow8_col3\" class=\"data row8 col3\" >0.6609</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow8_col4\" class=\"data row8 col4\" >0.4364</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow8_col5\" class=\"data row8 col5\" >0.3400</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow8_col6\" class=\"data row8 col6\" >0.3706</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83dalevel0_row9\" class=\"row_heading level0 row9\" >9</th>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow9_col0\" class=\"data row9 col0\" >0.8107</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow9_col1\" class=\"data row9 col1\" >0.7419</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow9_col2\" class=\"data row9 col2\" >0.3569</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow9_col3\" class=\"data row9 col3\" >0.6269</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow9_col4\" class=\"data row9 col4\" >0.4549</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow9_col5\" class=\"data row9 col5\" >0.3506</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow9_col6\" class=\"data row9 col6\" >0.3710</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83dalevel0_row10\" class=\"row_heading level0 row10\" >Mean</th>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow10_col0\" class=\"data row10 col0\" >0.8093</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow10_col1\" class=\"data row10 col1\" >0.7401</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow10_col2\" class=\"data row10 col2\" >0.3363</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow10_col3\" class=\"data row10 col3\" >0.6295</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow10_col4\" class=\"data row10 col4\" >0.4382</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow10_col5\" class=\"data row10 col5\" >0.3359</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow10_col6\" class=\"data row10 col6\" >0.3600</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83dalevel0_row11\" class=\"row_heading level0 row11\" >SD</th>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow11_col0\" class=\"data row11 col0\" >0.0052</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow11_col1\" class=\"data row11 col1\" >0.0190</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow11_col2\" class=\"data row11 col2\" >0.0134</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow11_col3\" class=\"data row11 col3\" >0.0243</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow11_col4\" class=\"data row11 col4\" >0.0149</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow11_col5\" class=\"data row11 col5\" >0.0172</td>\n",
       "                        <td id=\"T_1926a2cc_e614_11ea_ac48_482ae32b83darow11_col6\" class=\"data row11 col6\" >0.0186</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x1a14cbe7588>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "rf = create_model('rf')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "z6F3Fk7TEQp8"
   },
   "source": [
    "Notice that the mean score of all models matches with the score printed in `compare_models()`. This is because the metrics printed in the `compare_models()` score grid are the average scores across all CV folds. Similar to `compare_models()`, if you want to change the fold parameter from the default value of 10 to a different value then you can use the `fold` parameter. For Example: `create_model('dt', fold = 5)` will create a Decision Tree Classifier using 5 fold stratified CV."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "XvpjzbGQEQqB"
   },
   "source": [
    "# 9.0 Tune a Model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "nc_GgksHEQqE"
   },
   "source": [
    "When a model is created using the `create_model()` function it uses the default hyperparameters to train the model. In order to tune hyperparameters, the `tune_model()` function is used. This function automatically tunes the hyperparameters of a model using `Random Grid Search` on a pre-defined search space. The output prints a score grid that shows Accuracy, AUC, Recall, Precision, F1, Kappa, and MCC by fold for the best model. To use the custom search grid, you can pass `custom_grid` parameter in the `tune_model` function (see 9.2 KNN tuning below). <br/>\n",
    "<br/>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "BQlMCxrUEQqG"
   },
   "source": [
    "### 9.1 Decision Tree Classifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 392
    },
    "colab_type": "code",
    "id": "of46aj6vEQqJ",
    "outputId": "26f7f708-739a-489b-bb76-b33e0a800362"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "    #T_2699a2f0_e614_11ea_a64b_482ae32b83darow10_col0 {\n",
       "            background:  yellow;\n",
       "        }    #T_2699a2f0_e614_11ea_a64b_482ae32b83darow10_col1 {\n",
       "            background:  yellow;\n",
       "        }    #T_2699a2f0_e614_11ea_a64b_482ae32b83darow10_col2 {\n",
       "            background:  yellow;\n",
       "        }    #T_2699a2f0_e614_11ea_a64b_482ae32b83darow10_col3 {\n",
       "            background:  yellow;\n",
       "        }    #T_2699a2f0_e614_11ea_a64b_482ae32b83darow10_col4 {\n",
       "            background:  yellow;\n",
       "        }    #T_2699a2f0_e614_11ea_a64b_482ae32b83darow10_col5 {\n",
       "            background:  yellow;\n",
       "        }    #T_2699a2f0_e614_11ea_a64b_482ae32b83darow10_col6 {\n",
       "            background:  yellow;\n",
       "        }</style><table id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83da\" ><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >Accuracy</th>        <th class=\"col_heading level0 col1\" >AUC</th>        <th class=\"col_heading level0 col2\" >Recall</th>        <th class=\"col_heading level0 col3\" >Prec.</th>        <th class=\"col_heading level0 col4\" >F1</th>        <th class=\"col_heading level0 col5\" >Kappa</th>        <th class=\"col_heading level0 col6\" >MCC</th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83dalevel0_row0\" class=\"row_heading level0 row0\" >0</th>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow0_col0\" class=\"data row0 col0\" >0.8271</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow0_col1\" class=\"data row0 col1\" >0.7213</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow0_col2\" class=\"data row0 col2\" >0.3258</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow0_col3\" class=\"data row0 col3\" >0.7516</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow0_col4\" class=\"data row0 col4\" >0.4545</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow0_col5\" class=\"data row0 col5\" >0.3703</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow0_col6\" class=\"data row0 col6\" >0.4162</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83dalevel0_row1\" class=\"row_heading level0 row1\" >1</th>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow1_col0\" class=\"data row1 col0\" >0.8208</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow1_col1\" class=\"data row1 col1\" >0.7211</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow1_col2\" class=\"data row1 col2\" >0.3031</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow1_col3\" class=\"data row1 col3\" >0.7279</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow1_col4\" class=\"data row1 col4\" >0.4280</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow1_col5\" class=\"data row1 col5\" >0.3425</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow1_col6\" class=\"data row1 col6\" >0.3889</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83dalevel0_row2\" class=\"row_heading level0 row2\" >2</th>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow2_col0\" class=\"data row2 col0\" >0.8120</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow2_col1\" class=\"data row2 col1\" >0.7155</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow2_col2\" class=\"data row2 col2\" >0.3484</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow2_col3\" class=\"data row2 col3\" >0.6373</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow2_col4\" class=\"data row2 col4\" >0.4505</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow2_col5\" class=\"data row2 col5\" >0.3487</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow2_col6\" class=\"data row2 col6\" >0.3719</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83dalevel0_row3\" class=\"row_heading level0 row3\" >3</th>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow3_col0\" class=\"data row3 col0\" >0.8114</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow3_col1\" class=\"data row3 col1\" >0.7089</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow3_col2\" class=\"data row3 col2\" >0.2691</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow3_col3\" class=\"data row3 col3\" >0.6884</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow3_col4\" class=\"data row3 col4\" >0.3870</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow3_col5\" class=\"data row3 col5\" >0.2999</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow3_col6\" class=\"data row3 col6\" >0.3463</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83dalevel0_row4\" class=\"row_heading level0 row4\" >4</th>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow4_col0\" class=\"data row4 col0\" >0.8195</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow4_col1\" class=\"data row4 col1\" >0.6942</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow4_col2\" class=\"data row4 col2\" >0.2975</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow4_col3\" class=\"data row4 col3\" >0.7241</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow4_col4\" class=\"data row4 col4\" >0.4217</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow4_col5\" class=\"data row4 col5\" >0.3362</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow4_col6\" class=\"data row4 col6\" >0.3831</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83dalevel0_row5\" class=\"row_heading level0 row5\" >5</th>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow5_col0\" class=\"data row5 col0\" >0.8239</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow5_col1\" class=\"data row5 col1\" >0.7059</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow5_col2\" class=\"data row5 col2\" >0.3031</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow5_col3\" class=\"data row5 col3\" >0.7535</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow5_col4\" class=\"data row5 col4\" >0.4323</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow5_col5\" class=\"data row5 col5\" >0.3498</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow5_col6\" class=\"data row5 col6\" >0.4008</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83dalevel0_row6\" class=\"row_heading level0 row6\" >6</th>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow6_col0\" class=\"data row6 col0\" >0.8095</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow6_col1\" class=\"data row6 col1\" >0.7130</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow6_col2\" class=\"data row6 col2\" >0.2663</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow6_col3\" class=\"data row6 col3\" >0.6763</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow6_col4\" class=\"data row6 col4\" >0.3821</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow6_col5\" class=\"data row6 col5\" >0.2939</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow6_col6\" class=\"data row6 col6\" >0.3387</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83dalevel0_row7\" class=\"row_heading level0 row7\" >7</th>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow7_col0\" class=\"data row7 col0\" >0.8271</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow7_col1\" class=\"data row7 col1\" >0.7433</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow7_col2\" class=\"data row7 col2\" >0.2918</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow7_col3\" class=\"data row7 col3\" >0.7984</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow7_col4\" class=\"data row7 col4\" >0.4274</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow7_col5\" class=\"data row7 col5\" >0.3505</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow7_col6\" class=\"data row7 col6\" >0.4124</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83dalevel0_row8\" class=\"row_heading level0 row8\" >8</th>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow8_col0\" class=\"data row8 col0\" >0.8164</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow8_col1\" class=\"data row8 col1\" >0.7094</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow8_col2\" class=\"data row8 col2\" >0.2720</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow8_col3\" class=\"data row8 col3\" >0.7273</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow8_col4\" class=\"data row8 col4\" >0.3959</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow8_col5\" class=\"data row8 col5\" >0.3132</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow8_col6\" class=\"data row8 col6\" >0.3661</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83dalevel0_row9\" class=\"row_heading level0 row9\" >9</th>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow9_col0\" class=\"data row9 col0\" >0.8150</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow9_col1\" class=\"data row9 col1\" >0.6921</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow9_col2\" class=\"data row9 col2\" >0.3626</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow9_col3\" class=\"data row9 col3\" >0.6465</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow9_col4\" class=\"data row9 col4\" >0.4646</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow9_col5\" class=\"data row9 col5\" >0.3633</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow9_col6\" class=\"data row9 col6\" >0.3856</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83dalevel0_row10\" class=\"row_heading level0 row10\" >Mean</th>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow10_col0\" class=\"data row10 col0\" >0.8183</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow10_col1\" class=\"data row10 col1\" >0.7125</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow10_col2\" class=\"data row10 col2\" >0.3040</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow10_col3\" class=\"data row10 col3\" >0.7131</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow10_col4\" class=\"data row10 col4\" >0.4244</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow10_col5\" class=\"data row10 col5\" >0.3368</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow10_col6\" class=\"data row10 col6\" >0.3810</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83dalevel0_row11\" class=\"row_heading level0 row11\" >SD</th>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow11_col0\" class=\"data row11 col0\" >0.0061</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow11_col1\" class=\"data row11 col1\" >0.0139</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow11_col2\" class=\"data row11 col2\" >0.0312</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow11_col3\" class=\"data row11 col3\" >0.0481</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow11_col4\" class=\"data row11 col4\" >0.0270</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow11_col5\" class=\"data row11 col5\" >0.0247</td>\n",
       "                        <td id=\"T_2699a2f0_e614_11ea_a64b_482ae32b83darow11_col6\" class=\"data row11 col6\" >0.0245</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x1a14b8b8148>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "tuned_dt = tune_model(dt)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "__anDkttEQqV",
    "outputId": "7cf46ace-012a-4131-b8b8-370f9d4a63cb"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "DecisionTreeClassifier(ccp_alpha=0.0, class_weight=None, criterion='gini',\n",
      "                       max_depth=3, max_features=76, max_leaf_nodes=None,\n",
      "                       min_impurity_decrease=0.0, min_impurity_split=None,\n",
      "                       min_samples_leaf=3, min_samples_split=2,\n",
      "                       min_weight_fraction_leaf=0.0, presort='deprecated',\n",
      "                       random_state=123, splitter='best')\n"
     ]
    }
   ],
   "source": [
    "#tuned model object is stored in the variable 'tuned_dt'. \n",
    "print(tuned_dt)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "CD-f0delEQqq"
   },
   "source": [
    "### 9.2 K Neighbors Classifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 392
    },
    "colab_type": "code",
    "id": "xN1nYwFXEQqv",
    "outputId": "e4ab669d-bee0-4a9d-f5c7-2ed07ec613b9"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "    #T_04939fcc_e624_11ea_95c0_482ae32b83darow10_col0 {\n",
       "            background:  yellow;\n",
       "        }    #T_04939fcc_e624_11ea_95c0_482ae32b83darow10_col1 {\n",
       "            background:  yellow;\n",
       "        }    #T_04939fcc_e624_11ea_95c0_482ae32b83darow10_col2 {\n",
       "            background:  yellow;\n",
       "        }    #T_04939fcc_e624_11ea_95c0_482ae32b83darow10_col3 {\n",
       "            background:  yellow;\n",
       "        }    #T_04939fcc_e624_11ea_95c0_482ae32b83darow10_col4 {\n",
       "            background:  yellow;\n",
       "        }    #T_04939fcc_e624_11ea_95c0_482ae32b83darow10_col5 {\n",
       "            background:  yellow;\n",
       "        }    #T_04939fcc_e624_11ea_95c0_482ae32b83darow10_col6 {\n",
       "            background:  yellow;\n",
       "        }</style><table id=\"T_04939fcc_e624_11ea_95c0_482ae32b83da\" ><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >Accuracy</th>        <th class=\"col_heading level0 col1\" >AUC</th>        <th class=\"col_heading level0 col2\" >Recall</th>        <th class=\"col_heading level0 col3\" >Prec.</th>        <th class=\"col_heading level0 col4\" >F1</th>        <th class=\"col_heading level0 col5\" >Kappa</th>        <th class=\"col_heading level0 col6\" >MCC</th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_04939fcc_e624_11ea_95c0_482ae32b83dalevel0_row0\" class=\"row_heading level0 row0\" >0</th>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow0_col0\" class=\"data row0 col0\" >0.7788</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow0_col1\" class=\"data row0 col1\" >0.6377</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow0_col2\" class=\"data row0 col2\" >0.0567</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow0_col3\" class=\"data row0 col3\" >0.5000</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow0_col4\" class=\"data row0 col4\" >0.1018</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow0_col5\" class=\"data row0 col5\" >0.0594</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow0_col6\" class=\"data row0 col6\" >0.1077</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_04939fcc_e624_11ea_95c0_482ae32b83dalevel0_row1\" class=\"row_heading level0 row1\" >1</th>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow1_col0\" class=\"data row1 col0\" >0.7807</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow1_col1\" class=\"data row1 col1\" >0.6641</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow1_col2\" class=\"data row1 col2\" >0.0397</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow1_col3\" class=\"data row1 col3\" >0.5600</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow1_col4\" class=\"data row1 col4\" >0.0741</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow1_col5\" class=\"data row1 col5\" >0.0462</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow1_col6\" class=\"data row1 col6\" >0.1030</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_04939fcc_e624_11ea_95c0_482ae32b83dalevel0_row2\" class=\"row_heading level0 row2\" >2</th>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow2_col0\" class=\"data row2 col0\" >0.7820</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow2_col1\" class=\"data row2 col1\" >0.6994</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow2_col2\" class=\"data row2 col2\" >0.0595</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow2_col3\" class=\"data row2 col3\" >0.5676</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow2_col4\" class=\"data row2 col4\" >0.1077</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow2_col5\" class=\"data row2 col5\" >0.0686</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow2_col6\" class=\"data row2 col6\" >0.1286</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_04939fcc_e624_11ea_95c0_482ae32b83dalevel0_row3\" class=\"row_heading level0 row3\" >3</th>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow3_col0\" class=\"data row3 col0\" >0.7813</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow3_col1\" class=\"data row3 col1\" >0.6431</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow3_col2\" class=\"data row3 col2\" >0.0510</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow3_col3\" class=\"data row3 col3\" >0.5625</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow3_col4\" class=\"data row3 col4\" >0.0935</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow3_col5\" class=\"data row3 col5\" >0.0589</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow3_col6\" class=\"data row3 col6\" >0.1176</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_04939fcc_e624_11ea_95c0_482ae32b83dalevel0_row4\" class=\"row_heading level0 row4\" >4</th>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow4_col0\" class=\"data row4 col0\" >0.7782</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow4_col1\" class=\"data row4 col1\" >0.6417</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow4_col2\" class=\"data row4 col2\" >0.0482</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow4_col3\" class=\"data row4 col3\" >0.4857</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow4_col4\" class=\"data row4 col4\" >0.0876</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow4_col5\" class=\"data row4 col5\" >0.0497</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow4_col6\" class=\"data row4 col6\" >0.0954</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_04939fcc_e624_11ea_95c0_482ae32b83dalevel0_row5\" class=\"row_heading level0 row5\" >5</th>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow5_col0\" class=\"data row5 col0\" >0.7838</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow5_col1\" class=\"data row5 col1\" >0.6777</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow5_col2\" class=\"data row5 col2\" >0.0680</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow5_col3\" class=\"data row5 col3\" >0.6000</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow5_col4\" class=\"data row5 col4\" >0.1221</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow5_col5\" class=\"data row5 col5\" >0.0807</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow5_col6\" class=\"data row5 col6\" >0.1463</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_04939fcc_e624_11ea_95c0_482ae32b83dalevel0_row6\" class=\"row_heading level0 row6\" >6</th>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow6_col0\" class=\"data row6 col0\" >0.7845</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow6_col1\" class=\"data row6 col1\" >0.6421</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow6_col2\" class=\"data row6 col2\" >0.0312</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow6_col3\" class=\"data row6 col3\" >0.8462</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow6_col4\" class=\"data row6 col4\" >0.0601</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow6_col5\" class=\"data row6 col5\" >0.0451</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow6_col6\" class=\"data row6 col6\" >0.1365</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_04939fcc_e624_11ea_95c0_482ae32b83dalevel0_row7\" class=\"row_heading level0 row7\" >7</th>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow7_col0\" class=\"data row7 col0\" >0.7776</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow7_col1\" class=\"data row7 col1\" >0.6625</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow7_col2\" class=\"data row7 col2\" >0.0567</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow7_col3\" class=\"data row7 col3\" >0.4762</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow7_col4\" class=\"data row7 col4\" >0.1013</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow7_col5\" class=\"data row7 col5\" >0.0569</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow7_col6\" class=\"data row7 col6\" >0.1010</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_04939fcc_e624_11ea_95c0_482ae32b83dalevel0_row8\" class=\"row_heading level0 row8\" >8</th>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow8_col0\" class=\"data row8 col0\" >0.7719</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow8_col1\" class=\"data row8 col1\" >0.6287</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow8_col2\" class=\"data row8 col2\" >0.0340</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow8_col3\" class=\"data row8 col3\" >0.3429</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow8_col4\" class=\"data row8 col4\" >0.0619</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow8_col5\" class=\"data row8 col5\" >0.0229</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow8_col6\" class=\"data row8 col6\" >0.0439</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_04939fcc_e624_11ea_95c0_482ae32b83dalevel0_row9\" class=\"row_heading level0 row9\" >9</th>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow9_col0\" class=\"data row9 col0\" >0.7768</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow9_col1\" class=\"data row9 col1\" >0.6666</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow9_col2\" class=\"data row9 col2\" >0.0425</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow9_col3\" class=\"data row9 col3\" >0.4545</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow9_col4\" class=\"data row9 col4\" >0.0777</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow9_col5\" class=\"data row9 col5\" >0.0414</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow9_col6\" class=\"data row9 col6\" >0.0817</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_04939fcc_e624_11ea_95c0_482ae32b83dalevel0_row10\" class=\"row_heading level0 row10\" >Mean</th>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow10_col0\" class=\"data row10 col0\" >0.7796</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow10_col1\" class=\"data row10 col1\" >0.6564</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow10_col2\" class=\"data row10 col2\" >0.0487</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow10_col3\" class=\"data row10 col3\" >0.5396</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow10_col4\" class=\"data row10 col4\" >0.0888</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow10_col5\" class=\"data row10 col5\" >0.0530</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow10_col6\" class=\"data row10 col6\" >0.1062</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_04939fcc_e624_11ea_95c0_482ae32b83dalevel0_row11\" class=\"row_heading level0 row11\" >SD</th>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow11_col0\" class=\"data row11 col0\" >0.0035</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow11_col1\" class=\"data row11 col1\" >0.0205</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow11_col2\" class=\"data row11 col2\" >0.0112</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow11_col3\" class=\"data row11 col3\" >0.1240</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow11_col4\" class=\"data row11 col4\" >0.0192</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow11_col5\" class=\"data row11 col5\" >0.0151</td>\n",
       "                        <td id=\"T_04939fcc_e624_11ea_95c0_482ae32b83darow11_col6\" class=\"data row11 col6\" >0.0279</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x1a14c4f9688>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "import numpy as np\n",
    "tuned_knn = tune_model(knn, custom_grid = {'n_neighbors' : np.arange(0,50,1)})"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "KNeighborsClassifier(algorithm='auto', leaf_size=30, metric='minkowski',\n",
      "                     metric_params=None, n_jobs=-1, n_neighbors=46, p=2,\n",
      "                     weights='uniform')\n"
     ]
    }
   ],
   "source": [
    "print(tuned_knn)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "KO3zIfs-EQrA"
   },
   "source": [
    "### 9.3 Random Forest Classifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 392
    },
    "colab_type": "code",
    "id": "gmaIfnBMEQrE",
    "outputId": "a59cebfa-f81e-477c-f83c-e9443fd80b0f"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "    #T_d835ce90_e624_11ea_8738_482ae32b83darow10_col0 {\n",
       "            background:  yellow;\n",
       "        }    #T_d835ce90_e624_11ea_8738_482ae32b83darow10_col1 {\n",
       "            background:  yellow;\n",
       "        }    #T_d835ce90_e624_11ea_8738_482ae32b83darow10_col2 {\n",
       "            background:  yellow;\n",
       "        }    #T_d835ce90_e624_11ea_8738_482ae32b83darow10_col3 {\n",
       "            background:  yellow;\n",
       "        }    #T_d835ce90_e624_11ea_8738_482ae32b83darow10_col4 {\n",
       "            background:  yellow;\n",
       "        }    #T_d835ce90_e624_11ea_8738_482ae32b83darow10_col5 {\n",
       "            background:  yellow;\n",
       "        }    #T_d835ce90_e624_11ea_8738_482ae32b83darow10_col6 {\n",
       "            background:  yellow;\n",
       "        }</style><table id=\"T_d835ce90_e624_11ea_8738_482ae32b83da\" ><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >Accuracy</th>        <th class=\"col_heading level0 col1\" >AUC</th>        <th class=\"col_heading level0 col2\" >Recall</th>        <th class=\"col_heading level0 col3\" >Prec.</th>        <th class=\"col_heading level0 col4\" >F1</th>        <th class=\"col_heading level0 col5\" >Kappa</th>        <th class=\"col_heading level0 col6\" >MCC</th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                        <th id=\"T_d835ce90_e624_11ea_8738_482ae32b83dalevel0_row0\" class=\"row_heading level0 row0\" >0</th>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow0_col0\" class=\"data row0 col0\" >0.8258</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow0_col1\" class=\"data row0 col1\" >0.7863</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow0_col2\" class=\"data row0 col2\" >0.3654</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow0_col3\" class=\"data row0 col3\" >0.7049</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow0_col4\" class=\"data row0 col4\" >0.4813</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow0_col5\" class=\"data row0 col5\" >0.3891</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow0_col6\" class=\"data row0 col6\" >0.4194</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d835ce90_e624_11ea_8738_482ae32b83dalevel0_row1\" class=\"row_heading level0 row1\" >1</th>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow1_col0\" class=\"data row1 col0\" >0.8227</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow1_col1\" class=\"data row1 col1\" >0.7977</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow1_col2\" class=\"data row1 col2\" >0.3541</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow1_col3\" class=\"data row1 col3\" >0.6944</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow1_col4\" class=\"data row1 col4\" >0.4690</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow1_col5\" class=\"data row1 col5\" >0.3758</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow1_col6\" class=\"data row1 col6\" >0.4066</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d835ce90_e624_11ea_8738_482ae32b83dalevel0_row2\" class=\"row_heading level0 row2\" >2</th>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow2_col0\" class=\"data row2 col0\" >0.8233</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow2_col1\" class=\"data row2 col1\" >0.8225</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow2_col2\" class=\"data row2 col2\" >0.3853</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow2_col3\" class=\"data row2 col3\" >0.6766</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow2_col4\" class=\"data row2 col4\" >0.4910</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow2_col5\" class=\"data row2 col5\" >0.3937</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow2_col6\" class=\"data row2 col6\" >0.4165</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d835ce90_e624_11ea_8738_482ae32b83dalevel0_row3\" class=\"row_heading level0 row3\" >3</th>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow3_col0\" class=\"data row3 col0\" >0.8177</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow3_col1\" class=\"data row3 col1\" >0.7713</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow3_col2\" class=\"data row3 col2\" >0.3598</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow3_col3\" class=\"data row3 col3\" >0.6615</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow3_col4\" class=\"data row3 col4\" >0.4661</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow3_col5\" class=\"data row3 col5\" >0.3675</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow3_col6\" class=\"data row3 col6\" >0.3923</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d835ce90_e624_11ea_8738_482ae32b83dalevel0_row4\" class=\"row_heading level0 row4\" >4</th>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow4_col0\" class=\"data row4 col0\" >0.8227</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow4_col1\" class=\"data row4 col1\" >0.7805</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow4_col2\" class=\"data row4 col2\" >0.3513</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow4_col3\" class=\"data row4 col3\" >0.6966</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow4_col4\" class=\"data row4 col4\" >0.4670</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow4_col5\" class=\"data row4 col5\" >0.3743</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow4_col6\" class=\"data row4 col6\" >0.4059</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d835ce90_e624_11ea_8738_482ae32b83dalevel0_row5\" class=\"row_heading level0 row5\" >5</th>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow5_col0\" class=\"data row5 col0\" >0.8227</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow5_col1\" class=\"data row5 col1\" >0.7955</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow5_col2\" class=\"data row5 col2\" >0.3683</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow5_col3\" class=\"data row5 col3\" >0.6842</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow5_col4\" class=\"data row5 col4\" >0.4788</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow5_col5\" class=\"data row5 col5\" >0.3834</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow5_col6\" class=\"data row5 col6\" >0.4101</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d835ce90_e624_11ea_8738_482ae32b83dalevel0_row6\" class=\"row_heading level0 row6\" >6</th>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow6_col0\" class=\"data row6 col0\" >0.8158</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow6_col1\" class=\"data row6 col1\" >0.7568</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow6_col2\" class=\"data row6 col2\" >0.3371</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow6_col3\" class=\"data row6 col3\" >0.6648</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow6_col4\" class=\"data row6 col4\" >0.4474</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow6_col5\" class=\"data row6 col5\" >0.3507</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow6_col6\" class=\"data row6 col6\" >0.3799</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d835ce90_e624_11ea_8738_482ae32b83dalevel0_row7\" class=\"row_heading level0 row7\" >7</th>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow7_col0\" class=\"data row7 col0\" >0.8377</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow7_col1\" class=\"data row7 col1\" >0.7941</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow7_col2\" class=\"data row7 col2\" >0.3768</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow7_col3\" class=\"data row7 col3\" >0.7733</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow7_col4\" class=\"data row7 col4\" >0.5067</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow7_col5\" class=\"data row7 col5\" >0.4231</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow7_col6\" class=\"data row7 col6\" >0.4623</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d835ce90_e624_11ea_8738_482ae32b83dalevel0_row8\" class=\"row_heading level0 row8\" >8</th>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow8_col0\" class=\"data row8 col0\" >0.8227</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow8_col1\" class=\"data row8 col1\" >0.7671</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow8_col2\" class=\"data row8 col2\" >0.3569</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow8_col3\" class=\"data row8 col3\" >0.6923</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow8_col4\" class=\"data row8 col4\" >0.4710</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow8_col5\" class=\"data row8 col5\" >0.3773</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow8_col6\" class=\"data row8 col6\" >0.4073</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d835ce90_e624_11ea_8738_482ae32b83dalevel0_row9\" class=\"row_heading level0 row9\" >9</th>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow9_col0\" class=\"data row9 col0\" >0.8138</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow9_col1\" class=\"data row9 col1\" >0.7833</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow9_col2\" class=\"data row9 col2\" >0.3654</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow9_col3\" class=\"data row9 col3\" >0.6386</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow9_col4\" class=\"data row9 col4\" >0.4649</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow9_col5\" class=\"data row9 col5\" >0.3621</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow9_col6\" class=\"data row9 col6\" >0.3828</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d835ce90_e624_11ea_8738_482ae32b83dalevel0_row10\" class=\"row_heading level0 row10\" >Mean</th>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow10_col0\" class=\"data row10 col0\" >0.8225</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow10_col1\" class=\"data row10 col1\" >0.7855</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow10_col2\" class=\"data row10 col2\" >0.3620</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow10_col3\" class=\"data row10 col3\" >0.6887</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow10_col4\" class=\"data row10 col4\" >0.4743</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow10_col5\" class=\"data row10 col5\" >0.3797</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow10_col6\" class=\"data row10 col6\" >0.4083</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                        <th id=\"T_d835ce90_e624_11ea_8738_482ae32b83dalevel0_row11\" class=\"row_heading level0 row11\" >SD</th>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow11_col0\" class=\"data row11 col0\" >0.0062</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow11_col1\" class=\"data row11 col1\" >0.0176</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow11_col2\" class=\"data row11 col2\" >0.0128</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow11_col3\" class=\"data row11 col3\" >0.0339</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow11_col4\" class=\"data row11 col4\" >0.0154</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow11_col5\" class=\"data row11 col5\" >0.0188</td>\n",
       "                        <td id=\"T_d835ce90_e624_11ea_8738_482ae32b83darow11_col6\" class=\"data row11 col6\" >0.0220</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x1a14b8bf388>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "tuned_rf = tune_model(rf)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "IqxEZRi1EQrO"
   },
   "source": [
    "By default, `tune_model` optimizes `Accuracy` but this can be changed using `optimize` parameter. For example: `tune_model(dt, optimize = 'AUC')` will search for the hyperparameters of a Decision Tree Classifier that results in the highest `AUC` instead of `Accuracy`. For the purposes of this example, we have used the default metric `Accuracy` only for the sake of simplicity. Generally, when the dataset is imbalanced (such as the credit dataset we are working with) `Accuracy` is not a good metric for consideration. The methodology behind selecting the right metric to evaluate a classifier is beyond the scope of this tutorial but if you would like to learn more about it, you can __[click here](https://medium.com/@MohammedS/performance-metrics-for-classification-problems-in-machine-learning-part-i-b085d432082b)__ to read an article on how to choose the right evaluation metric.\n",
    "\n",
    "Metrics alone are not the only criteria you should consider when finalizing the best model for production. Other factors to consider include training time, standard deviation of kfolds etc. As you progress through the tutorial series we will discuss those factors in detail at the intermediate and expert levels. For now, let's move forward considering the Tuned Random Forest Classifier `tuned_rf`, as our best model for the remainder of this tutorial."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "w_P46O0jEQrT"
   },
   "source": [
    "# 10.0 Plot a Model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "FGM9GOtjEQrV"
   },
   "source": [
    "Before model finalization, the `plot_model()` function can be used to analyze the performance across different aspects such as AUC, confusion_matrix, decision boundary etc. This function takes a trained model object and returns a plot based on the test / hold-out set. \n",
    "\n",
    "There are 15 different plots available, please see the `plot_model()` docstring for the list of available plots."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "euqkQYJaEQrY"
   },
   "source": [
    "### 10.1 AUC Plot"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "RLbLqvkHEQra",
    "outputId": "fe40b5e3-6375-43e8-e97d-1d487e02eb2d"
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAfYAAAFlCAYAAAAZGcpRAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy86wFpkAAAACXBIWXMAAAsTAAALEwEAmpwYAACtjUlEQVR4nOzdd3gU1frA8e/WbHrvDRIIoffem6iAIKgoCmLD/rMrCCLXhqL3Wq+9IXIFQZFipSm9hRokoaRAeq+brTO/PwILawJJIMmmnM/z8DzT590hybszc857FLIsywiCIAiC0CIoHR2AIAiCIAj1RyR2QRAEQWhBRGIXBEEQhBZEJHZBEARBaEFEYhcEQRCEFkQkdkEQBEFoQdSODkBonTp06EBMTAxKpRKFQkFFRQVubm4sXLiQrl27AqDX63n//ffZvHkzWq0WgFGjRvHggw+i0+lsx1q9ejXLly/HYDBgNpvp3bs3zzzzDB4eHtWeu67bN7bMzEzuu+8+VCoVCxcupGfPnld0nNpc46v122+/sWzZMpYuXVovx5sxYwbp6em4u7vbLV+zZk29HP9SSktLefjhh/nmm29sy7Zs2cKXX35JSUkJFouF9u3b89xzzxEcHMyPP/7I77//zieffFJvMWRnZ/PYY4+xfPlyysrKuPfeeyktLeWBBx5g2bJlLF++vN7OJbRwsiA4QExMjJyfn2+37PPPP5dvueUWWZZl2Ww2y7fccov82muvyXq9XpZlWdbr9fLLL78sT58+XTabzbIsy/JHH30k33bbbXJubq4sy7JsMpnkhQsXyrfddlu1563r9o6wevVq+c4777zq49R0jevDr7/+Kt9xxx31drw77rhD/vXXX+vteLV19uxZuUePHrb5tWvXytddd52ckpIiy7IsS5Ikf/zxx/KYMWNko9Eo//DDD/Ls2bMbLJ69e/fKY8aMabDjCy2buGMXmgSLxUJmZiaenp5A5Z2gJEnMnTvXto2zszPz5s1j8uTJbNiwgeHDh/PJJ5+wevVq/Pz8ANBoNDz77LNs2LABk8lku9OHyicANW3/ySefUFhYyIIFCwB4//33bfMzZszA09OTpKQkpk2bxocffsi2bdvQarVYrVZGjBjB119/TUBAAK+++ionTpzAbDYzcOBAnn32WdRqNe+99x4bNmxAo9Hg7e3NokWLCAgIsMW4e/du3nnnHUpLS5kxYwZLly5lxYoVLF26FKVSiZ+fHy+88AJt27Zlzpw5FBUVcfbsWUaMGMEzzzxTp2ucl5fHggULyM/PJzc3l9DQUN555x18fX0ZNWoUN954I7t27SIzM5NJkybx+OOPA/Duu++ybt06vLy8iIyMtB2/tLSUf/3rXyQkJKBQKBg6dChPPvkkarWarl27ctddd7Fz5070ej2PPPIIv/32GydOnCAgIICPP/4YFxeXy8aflZXFwoULSU9PR5ZlJk+ezL333ktaWhq333470dHRpKens3TpUtLS0njrrbeoqKhAqVTyyCOPMHLkSHJzc3nuuecoLCwEYPjw4Tz++OPMnTsXg8HApEmT+PHHH3n77bd5+eWXbZ9PoVAwe/ZsgoODMZlMdnEdOnSIN998E5PJRG5uLoMGDeK1117DYrHw8ssvc+DAATQaDWFhYSxatAgnJ6dqlxcWFjJx4kR++OEHnn/+ebKzs5k0aRL/+c9/uOmmmzh48CAAH330EX/88QeSJBEaGsqLL75IYGCg3c/nbbfdxowZMy57PYWWSyR2wWHuvPNOAAoLC3FycmLkyJEsWrQIgIMHD9KnT58q+ygUCgYOHEhcXBzh4eHodDratGljt42zszM33HBDlX2TkpLqtH11PDw8+OWXXwDYsGEDmzdv5tprr2X79u2EhYURHR3N3Llz6dy5M6+//jpWq5U5c+bw1VdfMWHCBJYsWcKuXbvQarV8+eWXHDlyhDFjxtiOP2DAAP7v//7P9ph3165dfP7556xYsQIfHx9+/PFHHn74YX7++WcADAaDbbo6l7vGP//8Mz169GD27NnIsszs2bNZs2YNd999N1D5Reh///sf2dnZjB07lqlTp5KYmMgff/zBTz/9hE6n4+GHH7ad65VXXsHLy4t169ZhNpt58MEH+fLLL5k9ezYmkwk/Pz9WrVrFp59+yvz58/n111/x9/fnpptuYtOmTUycOBGAxYsX89FHH9mO++STTzJ8+HCefvppRo8ezV133UVpaSm33347wcHBdO/enaysLP7973/Tp08fiouLmTt3Ll988QVhYWFkZ2dzyy230KFDB1avXk1YWBhffvkler2eefPmUVpayqJFi5g4cSJr1qyhsLCQ9PR0evXqZXctFQpFtT8n33zzDf/3f/9H//79KS8vZ/To0cTHx2MwGNi7dy+//PILCoWCN998k8TERCRJqnb5+S94UVFRvPLKK7z88susWbOGtLQ027l++uknTpw4wcqVK1Gr1axYsYL58+fz2WefVfn5FFovkdgFh1myZAk+Pj4cO3aM2bNn079/f3x9fW3rLRZLtfuZTCZUKhVKpRJJkmp9vrpuX52Lv2zcdNNNrF69mmuvvZYff/yRW265BYA///yTo0ePsmrVKqAy+QIEBgYSGxvLjTfeyLBhwxg2bBgDBw687Pm2bdvG9ddfj4+PDwBTpkzh1Vdftf2x792792X3v9w1vvPOO9m/fz9fffUVKSkpnDx5ku7du9v2HT16tC1uX19fiouL2bVrF2PHjsXNzQ2AqVOn2t6vb926le+++w6FQoFWq+XWW29lyZIlzJ49G4Bx48YBEBERQUxMDIGBgQCEhYVRXFxsO++zzz7Ltddea/c59Ho9Bw4c4MsvvwTA3d2dKVOmsHXrVrp3745araZHjx5A5R10bm6u3ZcOhUJBYmIiQ4cOZfbs2WRmZjJo0CCeeuop3N3d7c6vVFa2Ka7tz8rrr7/O1q1b+fjjj0lKSsJoNKLX64mNjUWlUnHzzTczZMgQxo0bR7du3SgpKal2+cUJ/FK2bNnC0aNHmTp1qi3GiooK2/rqvgwLrY9oFS84XOfOnZk7dy5z5syx/XHr1asX+/fvr/LHVZIk9u3bR8+ePWnXrh0Wi4WUlBS7bYxGI/fddx/Z2dl2y2uzvUKhQL5o+ASz2Wy37cWPi6+77joOHz7M6dOn2bdvny0ZSZLEu+++y5o1a1izZg0rV65kwYIFKJVKvv32WxYtWoSXlxevvfYaixcvvuy1qS65yLJs+9JT0+Pr86q7xm+++Sbvvvsu3t7eTJs2jcGDB9t9dicnJ9v0xdfl4m1UKpVdrAqFwm7+4i9nGo2m2unakCTJ7rz/PL5Wq0WtrrxPsVqtREdH267/mjVrWLFiBUOGDKFbt25s2rSJadOmkZ6ezs0330x8fLzdcT09PWnTpg2HDx+uEsdjjz1GQkKC3bI77riDv/76i6ioKB5++GECAgKQZRkPDw/WrFnDc889h0ql4vHHH2fZsmWXXF7b63DvvffaPtcPP/zAd999Z1tf258HoWUTiV1oEiZMmEC3bt1sj4nHjRuHs7Mzr732mu2O12Aw8PLLL+Pq6srYsWPRarXcd999zJs3j7y8PKDybv61116joqLCdkd4Xm229/b25tixY8iyTFlZGVu2bLlkzE5OTowfP545c+ZwzTXX4OzsDMCQIUP4+uuvkWUZk8nEgw8+yLfffktCQgITJkwgOjqa+++/n1mzZnH06NHLXpehQ4fyyy+/UFBQAMAPP/xQ5d32lV7j7du3c+eddzJ58mR8fX3ZuXMnVqv1sscYNmwYv/32GyUlJUiSZNdafciQIXz77be2z/39998zaNCgOsdZHTc3N7p3725LgKWlpfz000/VHr9Hjx6kpqayb98+AI4fP864cePIzs7mrbfe4sMPP2TMmDHMmzePdu3acfLkSdRqNVar1fbl4ZFHHuHVV18lNTUVqPyy8OGHH5KQkEBUVJTtXCUlJRw9epSnn36aa665hqysLM6cOYMkSWzZsoVZs2bRs2dPHn30USZPnkx8fPwll9fGkCFDWLVqFWVlZUBle4dnn332yi+s0CKJR/FCk/HCCy9www03sG3bNoYOHcqXX37Jhx9+yJQpU1AqlVitVkaNGsWXX35pu+N74IEHcHZ25p577gEq77779evHhx9+WO05atr+/PmvueYaAgMD6devX5U7xYvdfPPNfPvttyxcuNC2bN68ebz66qtMnDgRs9nMoEGDuPfee9FoNFx33XVMnToVFxcXdDod8+fPv+w1GTx4MLNmzeLOO+9EkiR8fHz45JNPbI+L6+ria/zwww+zePFi3n33XTQaDb169eLMmTOX3X/48OEkJiYydepUPDw8iI2NtTVEmz9/Pq+88ortcw8dOpQHHnjgiuKszltvvcVLL73Ejz/+iMlkYuLEiUyZMoX09HS77Xx8fHjvvfdYvHgxRqMRWZZZvHgxYWFh3HnnncyZM4cJEyag1Wrp0KED48ePR6VS0a1bN8aPH8+yZcuYOHEisizz5JNPYrFYMBqNdO7cmSVLltg1yPTw8GD27NnceOONuLi4EBgYSK9evUhNTeXmm29m69atTJgwARcXFzw9PXn55ZcJDg6udnlt3HzzzbY2AwqFguDgYF5//fV6u8ZCy6CQL/dXSxAEQRCEZkU8ihcEQRCEFkQkdkEQBEFoQRo0sR8+fLjaIgmbN29m6tSpTJs2je+//74hQxAEQRCEVqXBGs999tlnrF271tZS+Dyz2cyiRYtYtWoVzs7O3HbbbYwcORJ/f/+GCkUQBEEQWo0GS+wRERG8//77VbpinD59moiICFtZy969e7N//36uu+66Sx5LkiTKy8vRaDR2/WQFQRAEoaWSZRmz2Yyrq2udesI0WGIfN25ctZWUysrK7EZucnV1tfXJvJTy8nJOnDhR7zEKgiAIQlMXExNTZcTDy2n0fuxubm6Ul5fb5svLy2sM+Hyf5ZiYGLs+pEL9io+Pp0uXLo4Oo8UT17nhiWvc8BrqGlutZsqMRZQa87FKVmRZQpKslBry6Ro+EqVCSU5JKmfyjyHJViRZokifhcVqwSpLRAdOosSowyIZyCn8rsrxJVlBQYUfG05HkZSfw7wRyXbrK0xKJOBEngtZZU64aiR8nM2YrAokFHT2L0NGgUopoVHKnL+RrjApKTFqCXQ3XPbzma1OqFVKFFSg0/igVmrpFDKEAI8gDAYjN94wFaPRyK+//oqzszMnTpyoc6XGRk/s0dHRpKamUlRUhIuLC/v377cVC7mU84/ftVqtXZlLof6J69s4xHVueOIaN7zqrrEsS5QaCjBZKiipyEehUNDWv3IMguTcI2QUncQqmVEolOSVpgEyVsnCjb2fQqVUcyb/FJuPL632fHszfcgscyK/LJ0BIXuq3eb27zZxMt8VrUpidh8VCoWMjILcMg06jUS5SYVVKifI/SA+zgruXRPB4LZBhHmaGBGxE/W5HNoluIzzX1vcnILQatywWCsoqbjwhNkKWM9VglFrwEcD5osqwwS4tyHAI5JAj0gUShV+bmHoNK5VYrZarahUKjzd4LnnnsPV1ZWAgACMRiNAnV9BN1piX7duHXq9nmnTpjFnzhzuueceZFlm6tSpVUp/CoIgCE2LxWpGbyrGZDGQU5rKWdMRzKfP0j9qEgqFgsyi02w49iWSXLUscVv/7kiSFb2pmOySFEoqcu3WmyUX3OYso1OgL166MiI9vdAoZQoqNGSVOWGRFFglOJl/nBKjGrVSYr1rNAazis4BMoHuFYAFF42FO3oaUSlK8XJ2psh8A0qFAp0qkx5Bm1EoqtZjGxdTgUqZhixLGKsfd4oyYxYYqy4P9+mIyVJBl7DhqJQavF2CUCpVOKmdq25cDVmW+c9//sNvv/3GL7/8gkajYdKkSbXa93IaNLGHhYXZurOdH5IRYNSoUYwaNaohTy0IgiDUgizLGMxllFTkk1t6BpPVQLmxiKziJCb1fBytWkdaYSIbj31VZd+izFT6tp2ASqFGpVTj5uSNUqnEYjXj5x6Jk9oDg8VCUn4pBXoTr20wkVboTZ7evfLOWVZQVKFGpvKO9FBGIZ46DcdyosgtM3Jdx1B83RWcziulb4Qfz40JQqkoBdlE19AOtPF24+CZXzmWvq1KbGqVlgldNaQXJmK2GDmdW32RVbPVgLO2sleWk8aVClMp7QJ6EeHb2W47ncYNVydPlAolalX9vBJWKBQkJyeTkZFBcnIyMTEx9XJcUSteEAShmZJlGaNFT5mxkApTKZIsIctWwn06oVKq0ZtK2Z/8M05qFwr1WaiVGkoMBciyxDVd7sFd50NG0Uk2HPuy2uNnFp0i0q8L3i5BuDp5odN4UWHWkJinwFhhpEgK49tPNuHlrMNslVj/dyBB7s5klVYAZiD/3JF+uuiomnP/INzLhZ6hHoR7u+KsUfHvG/qgVStQKipfXGcUnuRMwTHKDEXklx+ltLQUABetB+38+pJdnEJBeRYKhQqVQolFujAao8VqYtPfX1f7uYI8o/BxDSbStyu+biH1lqhrw2Kx8Ndff9mGRX7ttdeQJAkvL696O4dI7IIgCE2QJFkxWSuwSlaM5nJKDPkYzOW0D+yDSqkmp+QMvxypfrCjW/u/gEqpxmAuIyn3ULXblFQUklasotzohZPah2KjO2VmDSVGF3amqFAq3Xjy16MUGw7i7qSh1Bj6jyNogKIqx80qraBzkCdZJQb6RPiSVVJBz1Af1CoFVknmkSGx9Aj1wWjWU6TPwWApx2SpIK/0LGsOvI6XayDjutwLQH55OgmZuyvPptIR5BmFu84HD50faw68Q6E+68KJFSq8XYIwWMrx0PnhpvMGoMJUSrfwkSgVKrxdg9CoHNv24tFHH2XFihWsWbOGoUOH4uHhUe/nEIldEATBAQzmctILT2Awl1FckYfBVMqQmFvQqnXkl2Ww7tB71e4X7BmNp4s/KqUKJ7UrbjpvnNQuBHhEoFE5oVSoUCsr74jdnHwYEnMnJQZIL5F4cFUcueUyFkkBq3defNSLpq3n/hXYlpQazfSL8KXCbMXP1QmrJHNTpI7hvbuhVavwcdaiUSnRqJS4aNWYrUaMZj1W2YJVslBhKqXcWISL1oMwHx8A9iStIyn3oN1n02nccNFeSHTR/r0I9e6AWqkhrSCR/PJ0knIPYZUuvAz3d4+gS9hwIv/x6Lypuu+++1AoFA3aa0MkdkEQhAZgsZqpMJdSXJFLsT6HcJ9OeDj7kl+WzrpD71e7T4WpFK1ah1atI9CjLRXmMnzdQlAp1FgkM94ugei0bgD4uoVy24AXbPuWGsysjj9Dod7Evzbu5vfEDEoM5n+cQXHuH/QK8yGn1ECnIC86B3kiyTKuWjU3dY9Ep1bR1scNjUp5yRbZcXFxdAn2psJUSkH5GdRKT1y0lQ2h1x16n5KKvCr7hHnHEuYTC0CEbydctO44a93Rqp1xdfIkyDOKvNI01h58j4LyDJQKFaBAkqu2atOodHQMGUivyHGX+29wuBMnTrBgwQLee+89AgIC6NWr1yWHla4vIrELgiDUQYWpFL2pFLPVQEFZBkqlijDvWNx03qTkHWXHyVWYrVWbUMuyRJew4fi4Vt4d6zSueDj70cavGy5aD/zcwnB18gLAXefDdd3ur3KMnNIKDqaXYTAXc7ZIzyc7T1BiNHEsq/iyMfcM9aFfhB86jZLXru+FTqO64s9/PGMHWcVJZBvSOLH7Z4wWPQCdQ4fRt+31AEQH9KJYn4tKqUKlVJ9reOZl++xF+hyMFj2ezv7nLw7bT6xCb7L/HJJsxdctDAUK8srO0q/tBPzcI/B09sNJ43LFn6ExbdmyhT/++IPVq1dz//1V/08bgkjsgiAIQJE+mzJDERXmUgzmcgrKMjBZKwjxiqFz6BAAVsf9m+J/dNUCiAnMpGPIIII8o+jbdjx7k9bhrvO1vdd1dfIkwKMNAAqFkllDXq9VTEn5pSTmlLDhRAbvbk2o1T4Lx3UnzMuFKF93uod44+Vcu4ZhsixTWJ5JhbkMo6UCvbGIcmMxxRV5hHnH0OncNTiRtY9CfRZK1LhrfPBxDcHfI4Jgz2jbsdoH9EFvLgHAbDGQkLkHvamUY+lbKdLnXDYOVycvgjza0iF4AAEekbWKvalJSUkhIiICpVLJfffdR8eOHRk2bFijnV8kdkEQWrwTWXspMeRTUJaJVq1Dlq1YJStuOm8GRFf2G96W+D355elV9jVZDLQP7INWraOtf3dO5xwg0KMtZqsBN50vHs6+uDl54+nij1KhIiaoHzFB/WqMyWKVKDWaySkzkJBTwu6UXCySzIncEnLLDOw5U/VRNkCPEG96h/vSxseNvHID18WGMiYmuE5FTIyWCjKLTpFflk6odwxBnlGAzNYTKyjSZ1fZ3tXpwnvvQe2notO4khifRJ/efWzLZVliy/FlpOYfrVUMrk6e9Iy4xm6Zj2swPm4htf4cTdHvv//OXXfdxQsvvMCDDz6IUqls1KQOIrELgtDMybKM3lRCSUVeZbIqTyerIoWcI/u5tutsFAoFOSWpnMqJq7Kvl8uF4lidQoeQUXQSP7cwXLQeaNXOaNU63Jy80ap1APSIGEOPiDF1jvFgWgG7z+SSnF+Gi0bNyxuO1Hrfdn7uTOwcxvDoQK6LDUWtqvto27Isk1d2lozCk6QXniC39CwyEgAqpZogzygUCiWxwQMxmstx0rig07jirvPFWeuBi/ZC2W9/93BkWUZGJqPoJPuSfsZgLqfCXGp3zgCPSPzdwoHKhoJtA3rg5uSNTuNabfW1lqJXr15ERkYSHh7usBhEYhcEocmSZZkKUyl5ZWcxW00U6bPRG4tRKtX0ihyHs9aNnJIUfj36SZV9c0vPYLYa0ap1dAkbThu/rrg4eaJROdlajyuVF941Rwf0JDqg5xXHmVFSwa/H0/nleDrJ+WVo1Ur2n82vcd8xMcH4uzrh7eLEhE5huDupCfZwxtfVCQ/dlfWvLjcWkVeWjo9rMO46HxQKBX8m/I9yYxEKFPi7RxDi3Z5Aj7Z4uQTY9osNHnDZ4x5L387hs5swWSoq5+MvrFMqVEiylZ4RY+keMfqK4m6OJEni008/pW/fvvTu3Rt/f3927NhRp9HY6ptI7IIgNBqrZEGhUKBUqCgoyyAp7zAWq4n8snR0Glcyik7iovVgeIfp+LmHUWYs4If9b1Z7rE4hg3HWuuGm8ybMuwNKhQoftxC8XYLISC6gf5/B51pVg5dLgF0CuxqyLJOUX8ayuCS+P5zKydwSLFL1Vc0udm1sCO39PZjYKQwXrZqeoT5X1Yjtn4wWPRmFpziesYOc0lQAuoePpmfkWAB6hI9Go3Yi2KsdTuqaG54VV+RSUpHPqew40goT0GlcKDfaN24LcI9EqVQxqN0UPJz96u2zNCeHDh3i+eefZ9CgQaxfvx7AoUkdRGIXBOEqyXLlIB4mawVqpdb22HrnyR8pMeRRUJaBRTLbaoiPiL2dNn5d0ah1xKf9VeV4pYYC27buOl+CPKNQK7V4ugTg4xqMSqnCXedrSySuTl6M6XyX3THyUuNsSf1KSZLMoYwCSo2VJVE/3XWCvWcufQfu7qSha7AXHQI8uKd/e7oFe+HqVLdRuWpDluXKrmQKbK3KN/29hLMFx23bBHlGEerdgcBzDfYA2gf1rfZ45cZitp1YQYWpFJPVgEbpRImh6vv9cmMxOo0bMUH96B4+ikMHD9O7e+/6/XDNhCRJGI1GnJ2d6dWrFx988AFjx451dFg2IrELglAjSbZisZrRqnUYLXr2J/9KVnES5cZiuz7G/aIm0ilkMABnC49TYbrw3tVJ7YKTxsU2QIa7zoehMbfg4xqCSqm2vdP+Z0K+tuvsBv98siyTUlDGs+sPIMtgslr5+e+qDenOc3fSMCYmmOHRAdw7oD3Omob9U1phKiUlL56s4lPklaVRbiymrV93hsfeBoCHzpdgr3b4u0cQ5t3hsq3JJVkiNe8ofyVWHdIUoIJSnDXuVJjL8HD2o61fN9r6d8fT2Q+FwrF3ok1BXl4ed911F5GRkXzwwQcATJ8+3cFR2ROJXRCEKkwWAwXlGWQUnSQxcw9Gi97WT1ml1JBTkkKp4cLdq7PWnQD3CGT5wiPp0Z3uRIkSN50PGpVTta22owN6Ncrn+aeskgq2JmWTVqTnvzsSSCkov+S2jw2LxdfFiQqzlbv6tSPaz/2S2zaEQ2c2cjTtL6zn6qDrNG608etmK/QC0DdqwmWPIcsyOSWp5JaeYX/KL3br1CotaqWWMZ1n4anzR6MWw91ejqenJ2VlZRQXF2M2m+s8VnpjEIldEFqxUkMBuaVnyClJpV/bCSiVKo6c3cKB1N+rbFt8rhuUWqlhdKdZOKmd0aqdL9nNys8trEFjr4uskgo+3XWC1UfPciSzsNpt3JzU9A335ZEhsYxsF4RWrWzwO/GLybJMhbmMrKLT6E0ldAmr7CLlrvNBq9YR4dObzqFDav0uW5KsZBSd5GxBAolZu6usjw7oxcB2N9rKzwqXdubMGRITExk7diwajYaffvoJDw+POo+T3lhEYheEVsRsNbH5+DcU63OrVPlqF9gbP7cwwn06ciD1d9x1vrQL7I2r1pOogB52j8g9nH0bO/Qr9vqmo8z75VC16/47tT8AN3QOI8Sz8SuZZRcnk5x3BIO5nMyiU7YqbiqlmtiQgaiVGqL8e9bpyUZy7hH+Svxfteui/HsS6NGGdoG9USnFn//aMBqNXHfddZSVlbF//378/f3x9PR0dFiXJf5nBaEF0ZtKKDUUYLJUkF+WTnrhCUyWCqIDetMtfAQqpYqSigtJXat2po1fN4I82uKsqXzE7OUSwMzBr9mGzmxuZFlmeUI+36Xv5+2/jtute3tSH0a2D6JrsHcjxCFhtFRQZigkryyNvNKz5JSeAWBK76eAypbnCZm7gMpH7OE+HQnwiCTEqz2qc1+kanNXaLaaKK7IYW/SenJKUuzWdQ8fTaBHG0K829fjp2v5ZFlGoVDg5OTEiy++CICfX/No+S8SuyA0M0aLntPZBzidewhnjRverkH0bnMtAHEpv3E650CVfc4ncqVCxcDoKfi7h1+y1rZCoaRpPmCsnsliZXdqHl/tPUVGSQUbT2SeW3OhglrvMB/2PjG+Qc5fbiyu7F9vKsFiNdExZBAAiVl72X36J7tttSodbjpvJNmKUqEiwrcTfm5haNXOuGg97PrVX4osy5Qbi5GxUqTPYcvxZVUGSXFSu3Bz37moVeIxe13JssySJUv46aefWLVqFWq1mltuucXRYdWJSOyC0Ezkl2Ww+fg3lBuL7JZfPOBIiFd7tCodZqsRL5cAPJ398XOPwPnciGAAYT4dGivkBpFTWsHaY2lsPpnFrwnp1YxgVunWnm14ekRnuoV4oarnfsUlFXmcyonjbEECheWZtuVqpZbY4IEoFAo8nP0I847F1ckTL5dAAj3a4OUaaPdKQ6dxQ6dxq+4UdmRZotRQSGF5JlsSvr3kdmHeHWgf1K/ZDGHaFCkUCvbu3cuhQ4dITEykc+fmdy1FYheEJsBkMXA8cyfIMqn58UiylSJ9LlqVE+O6zsbXLQSrZLEl9VDvGCJ8OxPq1cGujvfVVE9r6tKKyol8+cdq13Xw92BMTDBDogIYExNM8vF4eveu3z7WVsliey+dUXSSI2e3AODrFkaod3vcnHxw03kBMqAgxKsdIV7trvq85cYiVu6rOmhMlH9PlIrKYVV7Rl5jN465UDeyLLN//3769q3s6//aa68xf/58QkKaZ916kdgFoRFZrCbyLadZe3A7ZquJ3m3G0cavG0aLnoOpf1TdXjJTmSjA1y2EW/vPr9UdXkuz9XQ2Iz+8cH3a+blz34D2xAZ6Mr5jaJX30Mn1cE5ZlsgqTia39CzZJUlkFyczqdfjuOt86RA0AHedL75uIQ32/2Ewl7N8z8t2y6L8e6BSaugRMdo2xKtw9Z577jk+//xz1q1bx+DBg/Hy8sLLy8vRYV0xkdgFoZ4ZzXpySlIwW01EBfQA4EDK7xxJ23Jho3NPj82Wysfo7jofekaMxcPZH1cnTzyc/aoMlKFSqlEpW3ZSN1msJOSUMO+XgyTmlJBWXI7RItltkzx/ChHe9TuISGX/exmFQoneWMKOU6vIK02ztVKHykaFFaYy3HW+KBQKQr1j6jUGqCwesz/5Z/7O2Mn5L3RQ2Tbixt5P4a7zqfdzCnDzzTeTmppKZGTzHCb2n0RiF4QrYLTo0aoq+3DnlZ7l8NktWCUzWcVJtnKoLloPQrzbVyboi24onRXexIb3ISaoH84XjZrVmgbOgMpkerZIzzf7T6NVKVlxMIVDGdX3MQcYGhXA6rtG4O1y9QVUJFkiuzjp3B35GXJKUriu2wP4uoWi1TiTUXQKV60nod4diPTtjJ97OK5ODdfFySKZSco5yM5TVV81TOr5BN6ugdXsJVypjIwM/vWvf/Hqq6/i5+dH3759WbFihaPDqjcisQtCDaySheKKXPLL0sk+92i2uCKHm/vOxdXJE4NZz9mCvwFQoMTVyQt/93B0Gje058qn9oy4hl6R4wCIi4uje0TrrLENEHc2n37v/HLZbcbFhnBTt0ju7BuFUqGot0IgZquJg6l/kJx32K7crZdLIFapsmW5Wqnhtv4LbDXv64tFMlOkzya/NB0ZuUqL+Yt1CRtOj/AxolV7A1m7di0rV66kQ4cOPPnkk44Op96JxC4I55gtRirMpeSWnsXTxR8/tzAk2crSnfOrbOvrFkaRPhtXJ0+CvaK5bcCLqBRqVEpVtfW0m2qFqsYgSTLLDiSTUlDGH4kZ7EzJtVs/sl0gI9sF0T/Sn85BngR71G+hGKtkQalQnRtVTkly3mGskoXogF6EencgwD3yXKO3C64mqcuydK6KXClZxckk5x4mrTDhkts7qV3wcgnEaNET5d+DdoG9RUO4BpCbm4uvry9KpZL77ruPkJAQJk6c6OiwGoRI7EKrlpp/jL1J69CqnSkqz0am8n1up5DB+LmFoVSoCPWOwWwxEuYTi597GAHukahVF8bJrnz3LX6VLlZiMJFTZmDsxxs5U2hfh12tVGCRZBLmTKK9f8MmMKNFz4b4L/H3iKRf2/GolGpGd5yJl2tQvZRSlWQru0+twSpb0JtKyCw6ddnt3Zx8CPftiFalw8slgBCv9pesJyDUn23btjFz5kzmzZvHvffei0ql4oYbbnB0WA1G/DUSWgWTxUBqfjwJmbuQZZkbev4fAFlFpyk3FlFuLKrs8+0WhlkyEewZbdt3bOe7HRV2syHLMptPZnHNJxsvuc1jw2J5ekRngj0uXV++PlglC6XWTLad+J60ggSMFj0uTp7IyCgAP/fwqz7HkbNbOJ6xkwpzabXrNSonfN1CkSQrvu5hRPh0JLgeur4JVyYmJgYPDw+cnFrHADcisQstVrE+l62Jy8kvrzr8ZoWpFGetOzFB/fB2DaKtfw80F92FC7Xz6a4T/OfPvykxmskuNdit83VxYkS7QCZ2DmdGn6hGiSe7JIUN8V9ikUyQU1kApnv4aLqFj7zq8dmh8kvD70c/I6c01W75NV3uwV3ni1qpsWsQKTiGLMv88MMPtGvXjh49ehAYGMi+ffvQalvH77hI7EKzJssyJmsFp7IPcPjsJkyWCq7pfA/+7hHoNK62pO7q5ElMYD/a+nfH1cnL9ujc2zUIb9cgR36EZmlncg5vbD7G+r/TbMtu7BqBSqngi2kDcXNqnEZfpYZ8TmTtI9K3C37uYbhqvXDTeaMyetC/8xj83cOvegxxWZZIyNyD2WqwG/XOWePO1D7P2L2WEZqG+Ph4Zs+eTZ8+ffj9999RKBStJqmDSOxCM3Y8Yxd7k9bZ3ouf98exL5g+YCFOGhcmdH8EL9dAMTRlPbBKElO++osdyTkUVphsy7uHeLP38etRqxp+0Bi9qZS0guNkFp8mt+QMZcbK7nFqlRY/9zDcdF5M7vUEcXFxBHhcXZ9kWZY4mb2/2i5oIzvOIMKnU6tuFNnUyLKMxWJBo9HQtWtXFi1axLhx41rl/5FI7EKTJssyRfocivTZpObHk1WcxIjY6QR5RuHtGohCoSDEKwZQEOYdS2xwf7s7ND/3pjMmeHN1MK2Ax3/ax/bkHNuyvuG+hHq5MLNPNBM6hdZ7LfbqmC1GNsR/QaE+C6gcUCXMuwPBXu1pH9inXo5vshpIL0ykoDzTNuraebHBAwn17kCQZ1s0qtbxrra5KC4u5tFHH8XLy4v33nsPgPvvv9/BUTmOSOxCk2S06Dma9heJ5x6BXiy/LJ0gzygCPdoyc/CrDoqwZUspKOOmr//iYHpBlXVbHrqGYdENXzDFbDVSrM+hUJ9Nu4DeaNRO9I0az6nsA3QJG4a3S9BV3Y0lZO7mWPpWSg1VP+PF2gf2oX/0JPHUpwlzdnYmJSUFd3d3DAYDOl391iBobkRiF5qM/LIMdpxcxZhOs5CRK/9wU9kAKjqgF94ugfi5h+HlUplUWuMjtoZmtkoEvbiSoosetUNlX/NHh3ZkfMfQBnvkLssyBeWZxKf/RUFZJqWGfFsVvyDPKNx1PoR4tSfE6+rGFd+f/Cvx6X9VWe6kdsVF645WrcPPPYJwn1gC3CNrNZSq0Pjy8vJITExk8ODBaLVaVq1ahZ+fH8pGeHrU1InELjiUVbLwZ8IysoqTbMOPJmTtpmfEWMJ8Ygn0aIOrk5dI4o2k57/X25K6VqXkx7tGcF3H0AY5lyzLlBjycNZUJlOrZGHdofds633dwghwj8DD2a9eqsCZLAb+t3uh3bJgz3aM6jRT9IhoZsxmM9dccw2FhYXs3r2bwMBAAgICHB1WkyESu+AwRfpsfjrwtt2yAI9IuoWNRKFQ4KR2xulcSVah4eSUVrDiUAqP/7Tftuz7O4cxtVv9D4ghyzLpRSc4kbmH7JIUjBY9w2JuJSqgB2qVhu7ho9CodLT171Zvo5etP/xfCsszbSVjAWKC+jEw+kbxhbGZ0mg0PPnkkxQXF+Pn5+focJockdiFRlVckUtJRT7hPrG4OXmjVmrRqJwY03kWvm4Nc2coVO9QegG9//NzleVTukXUe1KXJCsHz2wgrSDB1vjN1cmLEO/2dv2+e0ZeU2/nlGWJDce+Iq/0LFA5KI/ZauSGno+JUdKaofXr1/Pdd9+xZMkS1Go1d9xxh6NDarJEYhcaRWr+MfYn/0KpIR+t2pk2fl0Z1G4Ktw9ceNX9jIW6u+PbbXx3MMU23znIk56hvnx8c3+cNVf/Z8FgLierOAlvlyA8XfxRKlXklaZRXJFLuE9HuoePqpcKcNUpNxaTaT7Mkh0rbcs6BA1gYLvJDXI+oXGsXbuWzZs3c/jwYXr3br2DKNWGSOxCg5Jkid+OfGJXqatTyGC6hA0HEEndAU7lldiSur+bE7/eN4aeYVd/B5tdnMKJ7L0UlGdSWJ4JQKRvF0Z2rLyzGtrhFjRKJzTqhukqdib/bzYf/6bK8gHRk4kNHtAg5xQaVkJCArGxsQC8/vrrPPXUU3To0MHBUTV9IrEL9Soxaw8Zhado69+NNn5dUYAtqTtr3Lm57xzRythBjBYrLs/9z25Z1r9uuerjSpKVrSdWkJJ3xLYswD2SQM+2dnflDTViWZE+h3WH3rN7h+6q9CM6tBs9IsagFF8em6VXXnmFt99+m59//pkBAwbg4+ODj494hVIbIrELV02SJRIyd3EsfRvlxiIAZNlamdgVSgZET8ZZ40akXxfHBtqKrTycyq3fbLVbduzZKxvdyipZKDMWUlSeTaRfFyTZSvvAPqiUaiJ8OxPm3aHBR7uTJCtphYnV3qHPHPwqBw8colekeFzbnI0ZM4a//voLb29vR4fS7IjELlyVvNI01h/+wG7ZwHY30i7gwh9V8RjUcYorTCz47RAfbE+0LVsxcxg3da9b4ziTxUBaQQInsveSVZwMyEDlyHeh3jGEescQ4tW+wVuZJ+UeZlvicuRz5z8v2DOage2m4OHs26DnFxpOcXExixYt4tlnn8XHx4cBAwbwxx9/iJ4LV0AkdqFO8ssyiE/7i15trsFd52sbQMXLJYDOIUOJDuxVL6NoCVfnhV8P8trGeLtlMf4erL1nZJ3HQC+uyGXNgXdsxWL83MLwdAnAzy3UViwIGq5gkCxL/JX4HSl5R6usa+vfnb5tJ+AiRlRr9pYvX86nn36Ku7s78+bNA0QRqislErtQKzklqWw/uYqSilwAkvMOM7j9TbQP7MMdA18SI1w1EYczChjx3z8oMZhtywa38eeFa7oxJia4Vn8ozRYjh89uxt89nEi/Lnjo/AjyjCbAI4I2fl3tknlDkGQrZYZCkvOOkF+Wzpn8Y3brAzzacG3X+8QXyBagpKQEd3d3FAoF9957L87Oztx2222ODqvZE4lduCxJsrLh2JdkFp+2LesfNZEgz2jb3bpI6k3DllNZjPlog22+b7gvO/7v2joN0JJXmsb2k99TpM+hXUBvIv26oFAouKbL3Q0Rsp2cklRO5RzgRNaeatd3CxtJrzbjGjwOoXHExcVx55138tRTT3HXXXehUqmYOXOmo8NqEURiF6p1/rGrJFtx03lDMUT792RwzE3iTqmJWf93Gh/tSOS3hAzbsux/3YyfW93KsOpNpWw9sZySijxiAvvRt+34+g7VjtliJKskmaNnt9h1hzwv2DOaCN9ORPh2wUXrIR7LtjAhISGYzWZKS0sdHUqLIxK7YKfyDv0rMotPMaT9zbTx70a38FH0j7pB3Jk3IRarxO3LtrPqcNWEWPb6bXUuMrMv+WeOpW8DIMSrPYPaT6mXOP/JbDGy+sC/0ZtKql0f6NGWTqFDGqVlvdD4Nm/eTEBAAF26dCE4OJi4uDjc3NwcHVaLI35zBBuzrOebnfNs8yez99HWv7sov9nEvLXlGM+tP2C3bHT7INbdOwonde2epsiyRFZxEsFe7YDKQkGezv5E+fegY8jgeo3XaKkgKecQx9K3UWa0HyI12LMdapWWgdGTcXFqmH7uQtOQkJDATTfdRM+ePdm4cSMKhUIk9QYiErsAQKkhnwTDhbrh57sxCU3LU2v2887W47b5j28ewH0D6jaMqSzLbD+xkqTcQ0wfuBCNyokeEWPoHXltvT3uLqnI5/DZTZzOOVDt+ht6/B8+biH1ci6haZMkCaVSSWxsLPPnz2fMmDHitUoDE4m9FZNliSJ9Dt6uQVisF6p23dr/BXQaVwdGJvxTudFMm1d+pEBfOaTq4Db+bHn4mjo1jAPIL0tn099L0JtK0GlcbW0p1ErNVcUnyVayipM4nrGTswXHq6z3cwvH08WfbuEj8XT2v6pzCc2DXq9nwYIFALz11lsAPPnkk44MqdUQib2VyitLY/2hD/ByCWBij//Dw9mXME1fRve7UdRvb0L0JgtPr43jk10nbMum92rL0tuH1Ok4VslCYtYe9if/giRb8XYJYlD7qTipXeolzm92zKuyTKXUcE3newjwiBR3aK2QSqVi165dKBQK9Ho9Li7187Mm1Ewk9lZGkq38eXwZZwr+BirrbOtNJbjrfPBWtxFJvQmZ9s3WKo3jjj4zkU5BXrXaX5KtmK0mnNTOSLKVfUnrUSnVjIidToRv5yuKyWw1YjCXUWYoIjnvME5qF46m/WlbH+Xfk0jfzqJ8cCtVVlZGYmIivXv3xsnJieXLlxMQEICTU8MM/CNUTyT2VkRvKuH7va9dtETB7efesQpNR365kYAF39vmvZy1rJg5jDExwTXuK8syBeWZHEvfSlpBAm39ezCw3WQ0Kif6Rd1AkGdbW/2B2jqZvZ8jZzdjMOsxWw2X3K5r2Ah6t7m2TscWWg6r1cq1115LRkYGu3btIjAwkPDwhhmaV7i8BkvskiSxcOFCEhMT0Wq1vPLKK0RGXqhPvXbtWr766iuUSiVTp05l+vTpDRVKqyfLMrIsoVSoCHCPJKc0lQndH26w8bCFK2O0WLnv+10si0u2LZvYOYyf7h5Zq/0lWWLXqR85mb0fAFcnT7u2Eh1DBtYhFj0nsvZyIPUPZFn6x1oF7QJ6UW4splv4CFRKDd4uQQ02HKvQPKhUKu6++27Onj2Lp6eno8Np1RossW/cuBGTycSKFSs4dOgQr7/+Oh999JFt/eLFi1m/fj0uLi6MHz+e8ePHix+GBiDLMkt2zGVE7HTCfDrSP3oSPq5B4pF7E/PL8XQmfr7ZbtmZBVMJ9azde0lJtvLz4Y/IL0tDp3FlQPQkIn27XtG77UNnNnLozEa7ZcGe7Rjb+S4UCoX42RFsdu7cyTfffMN///tfW2IXHK/BEntcXBxDhw4FoEePHsTH2w9I0aFDB0pLS1Gr1ciyLBrXNIDzSR3gz4T/cWv/F/AVXYyaFL3Jwk1L/uL3i6rG/XLfaK7pcOm67rIsU24sIjX/GIEekfi5h6NUqCgzFBDsGc2QmJtxdfK6onhW7nvdNvSuUqGifWAfBkRPEslcqNYXX3zBmjVrmDlzJoMGDXJ0OMI5DZbYy8rK7IoPqFQqLBYLanXlKdu3b8/UqVNxdnZm7NixeHiI4hT16WjaX8Sl/GqbH9bhNtGFrQkxWqyM/nADu1JzbctctCpyXrrlslXjygxFbDuxguySysf1nUOH2l6p3NDzMVydruypV3ZxMiez99uSup9bOBN6PHxFxxJatrS0NMLCwoDKJ68PPPAAffv2dXBUwsUaLLG7ublRXl5um5ckyZbUExIS+PPPP9m0aRMuLi4888wz/Prrr1x33XWXPeY/7/qFS4uv+M02HaEdSOEZC3Fn4mrcLy6u5m2Eq7PlbAn9/vc/u2WP9QxkeqwPfx85XO0+FVIRGeYDVEiFyEi4Kv3wUIVhzfckruDq/s/STQcosF4Y5MddGUywdUCz/1lo7vE3RStXruSLL77gP//5D506dSIlJQWlUimudRPTYIm9V69ebNmyheuvv55Dhw4RE3Ohipm7uzs6nQ4nJydUKhU+Pj6UlFRfO/piXbp0Ed0mLqPUkI/eVEqgRxtcMgyUGgroFzWx1vvHxcXRu3fvBoxQAOj3v6W26e/vHMbUbpHVbifLku0ReGpePKcS8lErNfSLupH2gX2u6vVVqaGA7SdW2u78z5vc60k8nP1QNvNH7+JnuWEYjUa2bNlCp06dAMQ1bmBGo/GKbmgbLLGPHTuWHTt2cOuttyLLMq+99hrr1q1Dr9czbdo0pk2bxvTp09FoNERERHDjjTc2VCitwvYTKzmVE0e4T0f8Y8Prvd63UP/SXpxKsEf1jeMyik6x5/RahnWYhq9bKEGeUYzpfBehXjFXldBLKvLYfHwpRfpsu+V9246nc+jQKz6u0DJVVFTw7rvv8sADD+Dl5cWgQYPYsWMHarVa3KU3YQ2W2JVKJS+99JLdsujoaNv0bbfdxm233dZQp281ZFliyY7nbfNnC46jVIphVZuivDIDj/+0D4ChUQFVkrosS2SXpBCf9hdphYkA5JaewdctFCeNC2HeHa7q/IXlWaw5+I7dsmu63EvIuYFgBOGfli1bxuLFiykvL+fll18GsL1SFZou8T/UjEmyle/3LrLNt/XrzvBY8WWpKZJlmcAXV9rmR7e3LzZzKjuOYxnbKSzPBCqHL+3d5loCPKp/TF8Ts8VIcUUOfyb8D6NFj9lqtFs/tc+zYtQ+oVpGoxGtVotCoWDWrFno9XruueceR4cl1IFI7M2YVbLQPrAPR9P+5NquswnyjHJ0SEI1xnz0B1tOXXj0/Z/h4Tx2TTe7bp4GczlF5Vm08etKh6ABBHlGXdEj97SCRDYf/8Y2uMvFFCjRqp2Z2ucZtGrdlX8gocX6+++/ufvuu3nooYeYOXMmarWa//u//3N0WEIdicTeTOlNJThr3OgYPIhOIYNx1ro7OiShGjuTc2xJvb2fOy9d14M2lmyOpW/jZPZ+xnSahZvOm/aBfWjr3/2KuqtZrCbSChOJS/mNUkO+bXmYdwdKDAWM7XyXuDsXasXT05Ps7GxSUlIcHYpwFURib4aScg6x49QP9IwYS5ewYY4OR7iEk7klDP3gdwCifd1JmDsZWZZZuWsl+uR8VEoN2SUpuOm8cdK4UJv+HrIs83fGdizWyuFbD57ZUGUbtUrLbf0XoFKKX2+hZgcPHsTZ2ZnY2FhCQ0PZv38/vr6+jg5LuAriN7+ZyS9LZ+uJ5QAUV+Q4OBrhUmRZJvb1Nbb5Q09PwGwxkpC1G72Uj69rKKM6zbhshThJspJVkkxuSSpZxclkFp+65LbOGndcnTwZ2+XuehuKVWj5kpKSuOaaa+jatSsbN25EqVSKpN4CiMTejJQaClh36H0AvFwCGdz+JgdHJFRHlmV6vLXeNp/78i24aNX8cuRzckpSUKCkf/QNl03qRoue73a/dMn1/dpOwMs1EGTwcQsRVQWFKxIVFcVjjz3G0KFDUSqbd+0C4QKR2JsJg7mMH/Yvts1P6vm444IRqiXLMl/sOcX9K3fblj0zshM+LpUP2T2d/XFz8kJdElRta/fz3d1+O/qp3fLogF74uAYT7NUOH9eah24VhEsxmUz8+9//prS0lNdeqxzCef78+Q6OSqhvIrE3E2qllo4hg0krOM6NvZ8Sg+Y0IfvP5vPNvtP8d0ei3fL7+nkwMSaZYn0Eni7+DIiehEppX9ij3FjEX4nLKSzPrNIlDUS3NKF+SZLE2rVr0ev1zJ07F3d30ei2JRKJvRmQJCtKhYqOwQPp2/Z6lApRgKap2JCYwbWfbrJbdk+/QO7tayYhcxenciQ8XfzxdBlu15gtpySVX4589M/DAZV92Md0miXGNxfqhdls5uTJk3Tq1AmdTsfSpUsJCAgQSb0FE4m9Gfhuz8tE+HZiQPRkkdSbkE0nMu2S+g8zO+CpTeJMwZ/8nSHhpHZhaMw0wnw6IElWSgx5xKX8xtmK4xw9cuE4kb6diQnqT4hXOzE8qlCvJEli4sSJnD59mp07d+Lv70+7dqLSYEsnEnsTVmooYOfJHzBbDZzOOcDQmFscHZJwjuqppXbzpYtuIz7tV/7OOISHzo/OoUNp69+dgvIMfjv6KVnFSVWO4e8ewcDoyfi4hTRW2EIro1QqmTx5Mn///bcYQKsVEYm9iSo1FNg1lusaNsJxwQg2pQYzXvMquxt6OFmYOzyP+4c9gItWTWzwQMK8Y9l24nsSs/awL+VnW3/z86L8e2AsUjG2/82OCF9oBf7++2+++uor3njjDZRKJffff79ok9PKiMTeRO1NWmebnj5goSgB2kS89EflM/RRUflM756HAgsns7aTW3qG4opcDOYyACrMpbZ9XJ28uLbrfbjrKvsHi1GxhIb073//m9WrV3PttdcyevRokdRbIZHYm5jzY3C38etGQXkmN/V5Vrx3bQJkWebbuGQ+23WEh/pl0Du0FLVSg0WC+PS/qmx/fbeHCPCIcECkQmtUUFCAj09l74lFixYxbdo0Ro8e7eCoBEcRib0JKSjLID59K33bjic6oCfRAT0dHZJwzm1Lt7HycCqPDsigR3ApzhpPKszFtvU+rsH0bTuBYK/oyxxFEOrfkiVLmDdvHmvXrqVXr14EBARwzTXXODoswYFEYm8iivW5rD30HgAmi4ExnWc5NiDBJj6zkJWHU1EqZNr7VvY1vzip39x37hUN3iII9SEqKgoPDw9KS0tr3lhoFURibwIsVhOrD/zbNj88droDoxHOqzBbGPTubxzJLASgV0gJrtoLjeHCvGMZ3WmmeFUiNCqr1crnn3/OrbfeiqenJ0OHDiUuLg5nZ2dHhyY0ESKxO5jJYuB/uxfa5mcOfg2lSBQOZbFKjP5oA9uTc/BxNnFLlwKySrXc2SsTgGDPdozufCdqpcbBkQqt0dKlS5k7dy7Jycm8/vrrACKpC3ZEYnew4opcYoL6cSJrL5N6PiGSuoPtP5tP/3d+QauSuKtXJoMiilD+o1HxuK73OiY4odWyWq0olUoUCgW33347aWlpPPTQQ44OS2iiRGJ3IKtkwdPZn65hw+kZcQ3OWjdHh9QqybLMV3tPc9/3uwBQKWQe7n+GLoHlVbadOejVxg5PaOVSUlK4//77ufPOO5k+fToajUYM3CJclrg9dBBJlli6cz6nc+Jwc/IWSd1BFm+OR/30t7akrkBmwciUKkk90KMtN/WZg1IpSvoKjUulUnH8+HH27t3r6FCEZkLcsTvIyax9AOxJWkfHkMEOjqb1Ka4w4TN/BU4qKwPCSyms0HBH38E8MCiGgykrOFvwNwAuWk9u6vusqNEvNKqkpCQkSaJdu3aEh4ezY8cOwsPDHR2W0EyIxO4AVsnCrtOrAejT5noHR9M63bNiFwGuRp4ZkoKPiwV3nQ9m6xrWHzQgyRbbdrf0m+vAKIXW6OzZswwdOpTY2Fj++OMPVCqVSOpCnYjE7gAr971um44NGejASFqfAr0R/xe+J8pbz3NDz+LlbEGBklJDgW0bpUKFJFu5qc9zDoxUaK3Cw8OZOXMm/fr1Q6UST4qEuhOJvZEZzOW2cbkn9XxcdJlqZP4vfM/A8CLu7ZNuWyYj4ebkjYezH2M6zRLv0YVGJUkSX3zxBdnZ2bZGcYsWLXJwVEJzJhJ7I3NSuzCo3RQyik7h7Rrk6HBalYTsympxUd56u+UTuj+Cn3uYI0ISBEwmE59//jkFBQU88sgjeHl5OTokoZkTib0RGc160goTiQ7oSah3jKPDaXXu+PYXvrjxmN2ytn7dRVIXGp0kSZw5c4Y2bdqg0+n46quv8PX1FUldqBcisTcSWZZZvvcVIn27EOARYRvCU2gcyw+c4pH+h23zOo0bN/Z+Cie1qNglNC5Zlpk+fToHDx5k586d+Pr60qlTJ0eHJbQgIrE3koTMXciyREreEQa3v8nR4bQasizz1I9f0S3whG2ZGN9ecCSFQsGQIUNQKpVYrVZHhyO0QKJATSNJyTsCQHRALzQqrYOjaflkWWb5vtUs2THXLql3DBoskrrQ6M6ePctLL72EJEkAPPTQQyxbtoyAgAAHRya0ROKOvRGUG4vJLkkBoF/UBMcG0wrIsszC9a/Q1vtC9TijxZ2b+szC1y3UgZEJrdVLL73EDz/8QJ8+fbj++utRKsU9ldBwRGJvBGUX9ZF2Urs4MJKWL68sjfWHPqCtd+V8kcGV2/s/hr+7h2MDE1qd8vJyXF1dAXj55ZcZNWoU1113nYOjEloDkdgbQaBnWzoGD6Jz6DBHh9LiSLKExWri0Jnt/J2x0W5dtr4tz11zv4MiE1qz1atX88wzz/DDDz/QvXt3goKCuO222xwdltBKiMTewArLs/Fw9qV/9A2ODqXFMJr1bD7+DbmlZ5Hkqo2PiipUHMwZzZLbRzkgOkEALy8vLBYLaWlpdO/e3dHhCK2MSOwNqMJUxpqDb+Pq5MXNfec4Opxmr0ifTV5pGttPrqyyzipBQq4rGm0/Hhk2lMc9xSsPofHIssyqVasYN24cHh4ejBw5ksOHD+Pp6eno0IRWSCT2BhSf9icAoV6iGM3VsFhNLN/zChbJVGVddpmWH48FcCjLHeObdzogOkGAFStW8NBDD3HvvfeyePFiAJHUBYcRib2BmC1GjmVsByDEu72Do2m+UvKO8mfCMtu8Wqll+REvNiX54OFkJU+vYVxsKManRjswSqE1kmUZqOyXPmXKFOLi4nj00UcdHJUgiMTeYLafXGWbjvTt4sBImq+Sijy7pO6s9aDcWMKOM96YrCr+e9NIxsYE4+ks6gIIjSs7O5snnniCyZMnc8stt6DVannzzTcdHZYgAKJATYPJLkkCYEL3h1EoFA6Opvkpqcjnx7i37JZVmEr4K9mbEqOa58d04abukSKpCw5hMBjYtm0bP//8s6NDEYQqxB17A5nc6wmyi1Pwcw93dCjNiizL/JmwjNT8eNsyBQrCfHrw4OoiThe48MLYbiy8VrQ0FhpXdnY2BoOByMhIIiMj+eOPP+jQoYOjwxKEKkRibwB6UykuWnci/cQj+LqQZZlvds5DliXbMrNVwX/3hHM02wRUtnR/cLBojCg0rszMTIYMGUJ0dDS//vorKpWKjh07OjosQaiWSOz1TG8q4fu9r9E1bAS921zr6HCaDatkYenO+bb52OAhDP6wEA8nMyVGDQDdgr15bXxPAt3FiGxC4woODmbChAl06dJFvFoTmjyR2OvZ4TObADieuVMk9lrILk7m0JlNZBafsi1TKd0Y/GEBoKDEqOHHu0YwqYt4pSE0rtWrV3P69GmefvppAN59910HRyQItVOrxJ6WlsapU6cYOnQoGRkZhIeLP7KXkpi1B4BhMdMcHEnTVm4sYuW+16ssLzGqWHbYC6i8K/rp7hFM7Cx+3oTGZTQaefXVV8nJyWHWrFn4+fk5OiRBqLUaE/svv/zCRx99REVFBStWrODWW2/l2WefZdKkSY0RX7OSmnehwVe4TycHRtI0JeUeYs/ptbjpvMkvS7dbZ7Ao2XTah58T/TBaVUzpFsGi8T1p5ycGbxEaT3Z2NoGBgTg5OfH555/j7u4ukrrQ7NSY2D/77DO+++477rjjDnx9fVm9ejV33XWXSOz/IMsycSm/AdA9fLR4D3eRpJxDbD2x3DZvLNOjQIlapSW5QElaiYYVR4MIcPfm+1l9GN8xVFw/oVHJsszDDz/Mli1b2LlzJ97e3vTo0cPRYQnCFakxsSuVStzc3GzzAQEBYizhasiyRKfQIRw5u4WekWMdHU6TYLIY2Jf8Myez99mWuTn50D1iFGkloYz5eCMapYRZUjKqXRAbHhTXTXAMhUJBhw4dSEpKoqysDG9vb0eHJAhXrMbE3r59e7799lssFgvHjx/nf//7H7GxsY0RW7OiVKqI8u9BuI/oAiPJEhuPfUVG0Um75aM6zmTrieXsOLmKT/aGAZ6YJSUvXdudeWO7OSZYodUqKCjgm2++4bHHHkOhUPDII4/wyCOPoFKpHB2aIFyVGhP7ggUL+Oijj3BycuL5559nwIABzJkjRir7J6tkQaNyQqvWOToUhztydrNdUh8Wcys+biH8dvRTLFYTn+4LZW+6Jx46DXkv34JKPAESHGDevHmsWLGCNm3aMHnyZJHQhRajxsT++++/89RTT/HUU0/Zli1btozbb7+9QQNrTiRZYunO+bg5eXNT3+ccHY5DbTm+lNT8YwD0bTuBzqFDyC5J4efD/8VsNbIj1Ys9aV4AFLwyTbxLFxqV2WxGo6msi7BgwQK6dOnCxIkTHRyVINSvSyb2r7/+mrKyMpYvX056+oUWzFarlXXr1onEfpH9yb8AIMlWB0fiOLIs8/3e16gwlwLg7RJEx5BBAOw5vRaz1cje9Gi+OuAEwO/3jxFJXWhUmzZt4oknnmDZsmV07dqV4OBgHn74YUeHJQj17pKJvU2bNsTHx1dZrtVqef31qv2PW7O/zw3P2rvNdQ6OpHGZLUYOnd3EsfStdsvDfToyutOdtmEth7S/idO5h3hkfREyVuaO7sKYmGBHhCy0YpIkkZuby7Fjx+jataujwxGEBnPJxD5ixAhGjBjBddddR3R0tN06g8FQ44ElSWLhwoUkJiai1Wp55ZVXiIyMtK0/cuQIr7/+OrIs4+/vz5tvvomTk9NVfBTHMFkuXIso/x6OC6SRlBoKOJW9n/j0bVglc5X1/aMmERs8gO0nVhLu05FIvy74uIUw7rODVJgrn2i8cn3Pxg5baKU2bdpEv379cHd3Z+zYsRw8eJCgoCBHhyUIDarGd+ypqak8/vjjVFRUIMsykiRRUVHB7t27L7vfxo0bMZlMrFixgkOHDvH666/z0UcfAZWPbV944QXee+89IiMjWblyJenp6URFRdXPp2pEJ85VmvN0Dmjxj5YlWeKH/YurLB8QPZl2Ab1RqyrfXZ7KjuNUThwqpYZIvy58uecUB9IKAJg3RtwpCY1j7dq1zJo1i3vvvZfFiyt/bkVSF1qDGhP7okWLePnll/nqq6944IEH2LhxIxUVFTUeOC4ujqFDhwLQo0cPu8f6ycnJeHl5sWTJEk6cOMHw4cObZVIHCPOJpbgilxCv9o4OpcFYJQt/xH9BdkmybdmA6MmEecfipvOy27bcWMyu0z+hVmnpEjYMSZK57/tdAEzqEs5L1/VoxMiF1mzcuHHcfPPNzJo1y9GhCEKjqjGxu7u7M2DAAA4cOEBpaSnPPPMM119/fY0HLisrsytso1KpsFgsqNVqCgsLOXjwIC+88AKRkZE88MADdOnShYEDB172mNW9828KdLSloMRCwZk4R4dy1eLi4iiwJFFgSUal0AJQJmXZbdPeaRzlGRoSM07bLTdJ5Zw2bsKKmUB1FxLikxjw3XHb+nnd3ImLa/7XqD6I61D/ysvL+fjjj+nVqxcjR44kPj6e2bNnU1FRIa53AxHXtWmqMbHrdDqSk5OJjo5m7969DBgwALO56rvVf3Jzc6O8vNw2L0kSanXl6by8vIiMjKRdu3YADB06lPj4+BoTe5cuXZrUe/jfj35GbPBAgr3atYj+6/v27yFZ2ozeXFy5QLZff13X+wn0bFvtvrIss/bgu1gw0savK4Pb3YL/gh9s67c8dA29owMbKvRmJS4ujt69ezs6jBYnOTmZrVu3UlFRwYgRI+jTp4+jQ2rRxM9xwzMajVd0Q1tjZZDHH3+cd955h5EjR7Jr1y4GDx7MmDFjajxwr1692Lq1srX0oUOHiImJsa0LDw+nvLyc1NRUAPbv30/79s3rUbbeWEJm8Wm2JHyLLEuODueqmS1GjhlWozcV25bdPvAl7jj3b9aQ1y+Z1KGyJKdO40a3sJGMiL2dtq+uodRY+QXwv1P7M0wkdaEBlJSU2Lrjtm3bljVr1vD999+3+PYugnA5Nd6x9+vXj379+gHwww8/UFxcTGlpaY0HHjt2LDt27ODWW29FlmVee+011q1bh16vZ9q0abz66qs89dRTyLJMz549GTFixFV/mMa0N3k9AAEekThpXBwczdVJK0hk499f2eYndH8EP/ewWu1bpM+2NRwc2fEOtGodD6zcTWZJZTuMNyf25oFBMTUcRRDqLi8vj5EjRxIWFsb69etRqVTiDlIQuExiT05O5v3338fT05Onn34aV1dXysrK+OSTT1i2bBmHDx++7IGVSiUvvfSS3bKLu80NHDiQVatWXWX4jnN+iNZuYSMdHMmVs0hmfop7mzJjgW3Zdd0eqHVSzy5O4dejHxPl34OhMdPQqnWYLFY+211ZTvbRobE8OUIMXys0DD8/PwYMGEBUVBSSJImSsIJwziUT+9y5c+nWrRu5ubl8+OGHDBkyhGeffZbQ0FC++uqrS+3WKkiyFZnKx++h3h0cHM2VsUoWvt35gm3e2yWIYKk/gR5tarW/xWoiLvVXAII8o1EoFJQZzXg+f2F41ncm963XmAVh69atHD161FYx7tNPPxWP3QXhHy6Z2AsLC3n++ecxmUxMmDCBX3/9lTlz5jB+/PjGjK9JKjcWE+DRBqO5vFn+Udmf8ivxaX/Z5id0fxg/9/BatXCVZInMolMcOrOR3NIzBHq0pV1gb6ySRNi/LjSW+2b64AaJXWi9zGYzTzzxBOnp6UydOpWgoKBm+fsnCA3tkond2dkZqCwhazQa+frrr2nb9tKNp1oTd50P3cNH2VWdaw7KDIWs2v+G3bKJPR7F1y201se4eDjWcJ9ODO9wK4k5pXRZvNa2zbe3D+G2XuJnRagfJSUleHh4oNFo+Pjjj1Gr1aLQjCBcxiUT+8XfhL29vUVSv4jRoifUu3k1CMsrS2P9oQ9s80GeUYzrcl+d73gGtZvCyez9+LtHEOrdHoVCyazvNtrWPzWik0jqQr2ZP38+q1evZseOHXh5edG3r3i9Iwg1uWRiLyoq4qeffkKWZYqLi/npp5/s1k+ePLmBQ2uaTuccZPfpNQyMnkxUQA9Hh1Mrp7Lj2H5ypW3+9gH/QqOuWz0Aq2RBpVTjpvOmZ+RY2/ISg4n9Z/MBOPrMRDoFedVLzIIAlTcV7u7u5Obm4uXl5ehwBKFZuGRiHzBgAHv27KkyfV5rTezbTqwAoMxY5NhAaqFYn8svRz7GaLlQKOjmvnPrlNTNViOpefEcPLOBNr5d6N3mOpTKC62PH1x14edCJHXhapWXl7NixQruuusuFAoFjz32GA8//DA6XfMvACUIjeWSiX3RokWNGUez8Ef8l7bprmHDHRjJ5cmyzNKdLyDJFtuySN/ODO1wK2qlplbHkGSJo2l/cjxjJwZzGQoUaNXOdkn9cEYByw+mALDyzqZ7PYTm4/nnn2fp0qV4enoydepU1Gq1rWKlIAi1I35jasliNZNRdAKAXpHjmmxr3HJjMSv3XfhS5ucWxvDY23DX+db6GDklqWw/uZKSijwAOoYMpmPwIDyc7Y9xtkhvm76xa/hVRi60VpIkoVRWFsF85pln8PPzq9V4FIIgVE8k9lo6mb3XNt0tvGkWpZFkq11S793muit6smAwl+Oi9cDPLYzu4aPxdPGvso0sy0z6YgsAr4/v1WS/6AhN2759+3j88cf57LPP6NSpE2FhYbzwwgs17ygIwiWJxF5L4T6dUChU+LnVriqbI3yzY55t+ua+c3F18qz1vuXGYnLMfwO9ifDtRKh3DCrlpX883tuWYJse3k7UgReuTEFBAQkJCezYsYNOnUSVQkGoDzUOApOens5dd93FNddcQ05ODjNnziQtLa0xYmtS3HTexAYPqHW51cb0d8YOvtt9oXzv6I4za53UrZKFg6l/8GPcW2RbjmGRKgduuVRSl2WZQ+kFPLlmPwC39mxDvwi/q/wEQmuyf/9+28iP48aNY+/evdx3330OjkoQWo4aE/uCBQu45557cHV1xd/fnwkTJvDcc881RmxNhizLnM45iN5U4uhQ7EiSlWW7XmRv0jqMlsr33Z1DhhDuW7s7n1JDPiv3vc7hs5txUjsTqumNUnH5H4kbvthC7//8bJv/8tZBV/4BhFZnw4YNXHvttbz88su2ZRePISEIwtWrMbEXFhYyZMgQZFlGoVBwyy23UFZW1hixNRlF+my2nVjBr0c+cXQoNplFp/hm5zzMViMAwZ7R3DHwJfpGTajV/iUV+fxy5GMM5jJ83cK4sddT+KijUCouPZBGVkkFvxyvHCKzX4QvSfNuxEktBt4Qam/o0KGMHTuWSZMmOToUQWixanzHrtPpyMrKsjWO2r9/P1qttsEDa0p2nKysgV6Xd9YNSZIlfo//3DY/IHoyscED6nQMq2SmwlRKbPBA+kVNuGxCPy/0X5Wj8XUM9GTXY6LVslAzg8HAG2+8QY8ePZg0aRI6nY7vvvvO0WEJQotWY2KfM2cO999/P2fOnGHSpEkUFxfz7rvvNkZsTYIkS+SVnQUqu7k5Wl7pWbafvDDc7cxBr9r1La8tb9cghneYTlv/brXafk9qrm36gyn96nw+oXXKyMjgk08+oXPnztxwww2i94QgNIIaE3tYWBirVq0iJSUFq9VKVFRUq7pjT8y8UFktwCPSYXFUvuc/YFca9vpuD9Y5qWcWnUanccPbNbDWSV2WZYa8/zsAU7pFMKKdGIBDuDSj0UhxcTEBAQFERUWxfPlyevUSXSIFobHUmNhvvPFGOnbsyA033MDo0aNbVVIHKNRnAdCnzXUOi8FsNbJs14t2y6b2eaZORWeg8r36pr+/xipZuKnvnFq9Wnj0x718uCPRNv/AwOY1+I3QuIqKihg/fjze3t6sXbsWpVLJsGHDHB2WILQqNSb2LVu2sHv3btavX89bb71F//79ueGGGxg4cGBjxOdwA6Jv4ETWHmKC+jfqeSXZSnLuEVtt+vM6hQyhW/hIdBrXWh9LlmUSs/YQl/IrFslM17ARtUrqD6zczWe7T9rm353cl9ExwbX/EEKr4+npSXR0NP7+/phMJlHjXRAcoMbErlQqGTRoEIMGDWLPnj288cYbPPLII8TFxTVGfA5VYSrDWevGnYNfQ1FDN7D6JMsy3+5cgCRb7ZaP7/4Q/u4RdT5efPpfxKX8hkalY3D7m2gf2KfGfT7cnmhL6oPb+LP10WvrfF6hdThy5AhxcXG2gVu+/PJLUd9dEByoxt++v//+m3Xr1rFhwwbatm3LXXfdxdixY2vardkrrshl3aH3ifDpxNCYaY12Xkm22lWQaxfQm/5RN9R5mNXzKkxlHEj5Aye1CxN6PIK7zufy55dkXvjtEK9vigcgxt9DJHXhkqxWK/fccw+pqamMHTuWsLAwkdQFwcFq/A2cP38+kyZNYvny5fj5tZ4KY4fPbMJiNWG2Ghu10c8f8V/Ypge1m0pMUN+rOp6z1o1wn1higvrXmNSzy81onvnWbtnxOaK/sVCVwWBAp9OhUql49913MRgMhIU1vaqMgtAaXTKx5+bm4u/vz/vvv49CocBkMpGRkWFbHxIS0igBOorq3PCmbfy6Nsr5knOPcDrnAFnFSUBl3/SrSerlxmJctB4oFApGdLzjshXlrJLEHcu28/2hVNuyt27ozRPDRe1uoaq3336bpUuX8ueff+Lh4cGgQaL6oCA0JZdM7PPnz+eTTz5hxowZKBQKZFm2rVMoFGzatKlRAnQEq2ThZPY+AAI9ohr0XGariWW7Ftgtc9F61LngzHmyLJOUe5BtJ1bi4xrEhB6PXjKpy7LMf7cn8thP++yW//XwOIZEBVzR+YWWz2QyYTKZSE1NpWvXxvniKwhC7V0ysX/ySWX51B9//BEvLy+7dS19EJidp360TTdktTlZluySur97BD0ixhDqfeVdyhKz9rD79E+olVo6hw677J361/tO2yX15/oG8fQNw/BxubL3+ULLZDabWbt2LVOmTEGhUPDEE0/wwAMP4OnZNCoxCoJg75KJPTMzE1mWmT17Np999pntjt1qtXLffffx22+/NVqQjS3cpyNF+mwGRE9q0PfrS3Y8b5u+sfdTeDpXHfe8Lor02exNWodSoWZCj0fwcrn0XfeH2xN5dHXlGPNRvm6cmDuZAwcOiKQuVPHCCy/w6aefIkkSN998M1qtttXVsxCE5uSSif29995jz5495OTkcPvtt1/YQa1mxIgRjRGbw7Tx60qwVzROapcGO0dcyoUvRmM63XXVSV2SJTYc+xJJttIlbPhlk/qSfadtST3U04UDT04QVcGES3r44YcxGo2tojeMILQEl0zsixYtAuDTTz9l9uzZjRaQo/18+EPaB/a96tbolyLLMnEpvxKfvhWAKP8ehPl0uOrjWqwmgjyiMEsmekdevnvag6t226YT5kzCRSu6JwkXJCQk8NRTT/Hvf/+b2NhYwsPDefvttx0dliAItVRj1ZVx48axdu1aZFlmwYIFTJ06lfj4+MaIrdFlFJ0it/QMe5LWNtg5/oj/3JbUgXrrI69V6+gaPoI+ba6/7N13WlE5RosEQMbCm0RSF6pISkpi165d/Pzzz44ORRCEK1BjYn/++eeRJIlNmzaRnJzM3LlzeeWVVxojtka3N2kdAF1ChzbI8QvKM8ksPg1ApG/XcxXtru4R+J7Ta0nM2oMsy3i5BOLhfPn68V/uOVV5fm9XAt2dr+rcQstx4sQJ9Ho9ANdffz2bNm3iqaeecnBUgiBciRoTu9FoZPLkyWzZsoWJEyfSp08fTCZTY8TW6Ir02QB0CRte78feeepH1h68MNztyI63X1WZWkmWOJi6geOZO9l1ajUWqXb/J6uOVPZVv7132ys+t9CybN++neHDh/Pqq6/alvXs2dOBEQmCcDVqzCwqlYrff/+dP//8kxEjRrBx40aUysarm95YDOZy27RGVb8tw/ecXsuJrL22+Vv6Pn+ZrWtnf/LPHD67CWetO2M63VWrmF/49SDHsooBeOnaHlcdg9Ay9O7dm169erWagZ0EoaWr8QXrSy+9xNdff82LL75IQEAAP//8c4t8FH+24DhArQZIqQurZOF45k4AuoePonvEmMv2La+N+LSt/J2xo7JbW/dHauxrH59ZSPe31tvm/d2cRCv4VsxqtfLxxx/Ttm1brr/+epydnVm/fr34mRCEFqLGxN6hQwdmzZrFvn37+Prrr5k9ezaxsbGNEVujCvfpyMjYO3Bx8qi3Y8qyzNKd823zPSOvqZdjnszeh1Kh4tqu99WqgM7FSb1PuC+7H3Pc2PKC4505c4ZXXnmF6Ohorr32WpRKpUjqgtCC1JjYf/rpJz744APGjBmDJEk88sgjPPjgg9x0002NEV+j0WlcifTrUq/HPJN/zDZ9Y6/6aYikUCgY2O5GAAI8Imvc/oGVF7q2Jc+fQoR37cdxF1oOSZIoKSnBy8uLtm3b8vXXX9O7d+8W+VpNEFq7GhP7V199xcqVK/H29gbggQceYObMmS0qscuyzN6kdXQIHnDZwi51dTJ7P1D5NMDT5coL0EiSlUNnNhLkFU2wZzRBnrWrX78jOcc2pvr0Xm1FUm+lSkpKuPXWW9Fqtfz4448olUrGjRvn6LAEQWggNX5dlyTJltQBfHx8Wtxju+ySZI5n7uS3o5/W2zHXHXqftMIEALqHj77i4yRm7mHV/sUcSdvC9hPfY5XMtdpPkmSGffA7AJ46DUtvH3LFMQjNm7u7O56ennh6elJRUeHocARBaGC1esf+6quv2u7QV61a1eLesZ/KjgMgyLN+uoCdyf+b/LJ0oHJgF1+30DofQ5ZlTuXEsev0agCCPdsxtMM01Kra1eie/+tB23TWv26u8/mF5i0lJYU9e/Ywbdo0FAoFX375JTqdrsV9KRcEoaoaE/srr7zC+++/z/PPP48sywwYMIAXX3yxMWJrNNklyQB0Cqmfu9rNx78BwEntyvjuD13RMeJSfyM+7S9USg2jO80kxKt9rffddyaPNzZXvt9/dmRntGrVFcUgNE+SJHHrrbeSlJREv379aNu2Lc7OohiRILQWl03sZWVlnDlzhkceeYRnnnmmsWJqdKWGAgD83MOu+lhLtl/oo35r/3lXfBwXjTteLgGM6jgTD2e/Wu/32e6Tdg3mXhsvCo20FlarFZVKhVKp5I033iAvL482bdo4OixBEBrZJd+x//rrrwwaNIi7776bUaNGsXfv3ktt2qxVmEpt00rF1d3Z7j69BpnKOuyRvl3rXFlOlmUk2QpAbMggxnd/pE5JXZZlu6Re8cZ08ei1lfj6668ZOnQoJSUlAAwfPpypU6eK/39BaIUuecf+0UcfsWrVKmJiYti2bRvvv/8+S5cubczYGoVCoaBv2/GUGvKv6jiSbCUhcxcAPq7BjOx4ew17XCDLMolZezh0ZiNOahe6R4wiyr8Hylq+Tz/v83N14AEsb90h/qi3Iunp6WRmZpKQkEC/fv0cHY4gCA50yVtKhUJBTEwMAEOHDqWoqKixYmpUOo0bHYIG0Kft+Ks6zrH07bbpG3o+Vuv9rJKFvxK/Y/fpnzCYy/FyCSTAvU2dz2+0WG1361O7RYik3sLJssyGDRuQZRmAZ555hl27domkLgjCpRP7PwtXqNUtc3hPg7kMpVKJWqm5quPEpfwGQJ8219d6H7PVyO9HPyMl7wj+7hFM6f00IzvejpvOq87nd3nuf7bp72Y0zOh0QtPxyiuvMG3aNFatWgWAVqslKCjIwVEJgtAUXDJbl5eXs3//ftsdgV6vt5vv27dv40TYwJbveQWNyonbB/7rio9xMHUDUHld2gfV/rr8nb6dnNJUQr1jGNHhdjTqKxt85uU/jtimjz17AypRTazFmzFjBqdPn2bw4MGODkUQhCbmkok9MDCQd9+9MMxoQECAbV6hUPDNN980fHQN7PyXlPMN1q6ExWri8NlNAIR5x+Kkrn23oqiAHvi5h+PnHn7FST2rpIKFvx8GKodijQ2suXa80PykpaUxZ84cXnzxRdq3b0+bNm34+uuvHR2WIAhN0CUTe0tsKPdPRoseAD+38Cs+RmLWHtv0yI531Glfd50v7jrfKz43wDWfbAAgyN2ZJbeJu7eW6uDBg/zyyy+0a9eOhQsXOjocQRCasJb54ryWzg/VqlZd+fv1Q2cq79Z7RY5Dpazd5SypyONY+jZ6RIzFWet2xef+cHuibXz1X2aPEg3mWpiMjAx8fHzQ6XRMnDiR1atXM2zYMEeHJQhCE9eqX8buS6ocztTHNaTO+5osBn4/+hlmqwGACN/Otdovt/Qsqw/8h8SsPZzOiavzec/7Ys9JHl1dWVtgdPsguof4XPGxhKZn3759DBo0iEWLFtmWDR8+XHx5EwShRq36jj0qoCcJmbvoFj6yTvvtS/6FY+lbbfOezgG1GhWu1FDAxmNfIcsyfduOp3PolbVe/3TXCR5cdeEVwG+zx1zRcYSmq1OnTrRp04bo6GhHhyIIQjNTY2IvLi7mzTff5MyZM7z33nu88cYbzJkzB0/P5t9Ia0D0JPpH3VCnuyCjRW9L6jqNG+O7P4S7rua75XJjMXtOr8Vo0dMtfNQVJ/Xj2cV2Sd305u0oleIurrmTZZnvv/8eHx8fxo4di6urK5s3bxbjpQuCUGc1/tV44YUX6Nq1K0VFRbi4uBAQENAi6sZbJQuF5Vl1frS5L+ln2/St/efXKqnLssS2EytIK0zARet5xUldkmS6LF5rm7f+e4bo2tZCnD17lscee4znn38eq7Wyl4ZI6oIgXIka/3KkpaUxbdo0lEolWq2WJ554gqysrMaIrUHtOrWaXadX24ZsrQ1Jljh17r34yNjat4BXKJSM63IvozvNYlKvx+vUJe48g9mK9tlvbfP5r0yr8zGEpkWWZcrLywGIiIjgww8/5IcffkClEqPxCYJw5WpM7CqVitLSUtudbUpKSq3uJCRJYsGCBUybNo0ZM2aQmppa7XYvvPACb731Vh3DvnqncuLIKUnFsxbvxs/beOxr23RtGsvJskRu6RlkWUahUBLuU7d+7heOI+M653+c63bPmxN74+VctzryQtOi1+uZOXMmM2bMsNVTmDJlChEREQ6OTBCE5q7GDP3oo48yY8YMMjIyeOihh5g+fTqPP/54jQfeuHEjJpOJFStW8NRTT/H6669X2Wb58uWcOHHiigK/GnpjiW3a3712fdhNFgMZRZWxXtPl3lo9wj+esZOfD3/IkbObryxQYMXBFNRPX7hT3/zQNTw5otMVH09oGpydnTEajZjNZkpLS2veQRAEoZZqbDw3bNgwunTpwpEjR7Barbz00kv4+dU8lGhcXBxDh1a+S+7Rowfx8fF26w8ePMjhw4eZNm0aSUlJVxj+lTmStgWoWze3lfsudDsK8WpX4/YlFfnsTa7sTtfGr1sdI6xUYbYw/dtttvnv7xzG8OjAKzqW4Hi5ubns3r2bkJAQFAoFn3/+OW5ubuJduiAI9arGxP7BBx/YzR8/XlnU5ZFHHrnsfmVlZbi5XSi+olKpsFgsqNVqcnJy+OCDD/jggw/49ddfax3sP78cXAlJlkgwnBte1dKJuLia37EXWlIwW40AhGv612qfbPOxynOoojh1/Axwpk5xWiWZgcuP2+b3Tu8E5jzi4vLqdJy6qs1nE+pOlmUefPBBUlNT+fTTTx0dTqsgfpYbnrjGTVOd+rGbzWa2bdtG9+7da9zWzc3N1jAIKt+5nx8h7rfffqOwsJDZs2eTm5uLwWAgKiqKKVOmXPaYXbp0wcnpymqqn2eyGPDIldh1ejWD+4yu8ZG6JFv5ZsdKAPzcwhjd48YazyHLMqsPbEFpVTGu7x04qV3qFOOWU1mM+WiDbf7X2aPp3aHuRXTqKi4ujt69ezf4eVqTyvYVlT9jixYt4tSpU4SGhorr3MDEz3LDE9e44RmNxiu6oa0xsf/zzvzhhx/m7rvvrvHAvXr1YsuWLVx//fUcOnTINrY7wMyZM5k5cyYAP/74I0lJSTUm9fqiVesI9GzLrf3n15jU49P+Yn/KhScK47rOrtU58svTKanII8SrfZ2SelGFCd/5K+yWfX/nMK5phKQu1L+1a9fy/vvvs3r1atzc3BgzZgxjxowRdzmCIDSoOleeKy8vJyMjo8btxo4dy44dO7j11luRZZnXXnuNdevWodfrmTbNcV218krPotO4o9NcvkZ7VnGSXVIf2/luNKratUT3cQ0hxCuGDsH96xTbY6v32aandovgi2mDcNdd3TjxguMcPnyYY8eOERcXx/Dhwx0djiAIrUSNiX3UqAuDi8iyTHFxMffee2+NB1Yqlbz00kt2y6orj9lYd+oAFsnM+sP/JcAjkuu7PXjZbX87euE96KwhVVv0X45SoWR47G217tqWV2Yg8MWVtvkPpvTjwcEd6nROoWnYt28fffr0QaFQ8OyzzzJ9+nRRFlYQhEZVY2J/55138PWtHFpUoVDg4eFh1yiuOakwVXZzs1otl93ueMZO2/TNfefW+viyLJOQuZNgr3Z4udSu9XqF2WKX1MfEBDN7YPtan1NoOt5++21efvllPv/8c6ZMmYKTk5NI6oIgNLoaE/tzzz1Xp5brTZneWNlfuKahUk/nHAAgxKs9rk61r4kfn/4XcSm/EeHbmVEdZ9S4fVpROZEv/2ibT54/hQhv11qfT2haJk2axF9//UXnzrUb6U8QBKEh1NiBNjY2lp9++omkpCQyMjJs/5qj7Se/B8DbNfiS25RU5JFXlgZUvlevLVmWOJ6xC43KiYHRk2u1z/0rd9umdz12nUjqzUxhYSGPPvqorQ5DVFQUP/30Ex06iNcogiA4To137IcPH+bw4cN2yxQKBZs2bWqwoBpKqaEQgEDPtpfc5se4yvK2aqW2TgPEpBWeQG8qpo1fV5y17rXa54/ETAD2PH49fcJ9a30uoWnYunUry5YtQ6fT8eabbzo6HEEQBOAyiX316tXceOONbN585eVQmxJZlon270FxRS5h3tXfUSXlHLJN39Lv+Vof22QxcOhMZb/zDkEDarWPJMlI52qEdwv2qvW5BMcqKipCp9Oh0+m44YYb+Prrr7n++usdHZYgCILNJR/Ff/PNN40ZR4NTKBQMibmZ0Z1mXXKb8yO3xQYPRKvW1frYe06vIb8snTDvDgRd5mnAxd7dVllVLsTDGa1ajObVHMTHxzN48GAWL14MVP5M3XDDDbbCS4IgCE1Bq/mLVGEqRa3SXrLhnNGiJ6PoJAD9o26o07EHt7+JDsED8HULRaGoue53fGYhT6+t/BIxvVftvggIjtemTRvc3Nzw8PBwdCiCIAiXdMnEfvLkSUaPHl1l+fkSmc3tHfum49+gNxYztvPdeLsGVVl/6MyFz1Pbd+smi4FSQwG+biEEeETWap+c0gq6v7XeNr/gmisbIEZoHBs3bkStVjNixAjc3NzYtm0bWq0YMlcQhKbrkok9MjKyRQ1WkVd6FgA3nU+169MLK4dkvbaWZWPTChLYcfIHNGodN/Z6slZfBv48lcXoi2rAF792K65OorJcU5WRkcHtt99OSEgI+/btQ61Wi6QuCEKTd8nErtFoCA0NbcxYGozRUmGbrq4sbGF5NiUVucDlu8Kdd+jMRg6d2QhAG7+uyLKEQlHze/IHLurelv2vm3ETSb1JMpvNaDQaQkJC+M9//kP37t3Fe3RBEJqNS/616tWrV2PG0aByipMBCPSo/n32hmNfAKBQKGssA2u0VBCfthVnrTvDYm4l2KvmymK5ZQaCLqou9/dzN+DnVvvGeULjMBqNPPfcc2RmZrJ8+XIUCgW33367o8MSBEGok0sm9gULFjRmHA0qo/g0AC7aqo2eJMmK/lyp2Zv7zKnxWEfP/olFMtEteFStkvotS/7ihyMXxmK/q180HQJqX81OaDxarZazZ8+SnZ1NYWEhPj7Vv7YRBEFoylrF88UA9wiOs4M2/lUbqm34+yvbtIvT5Vs7y7KMk8YZd50vHUMG1njeHck5tqQe7OHM9kevpY1P86yz31KVlpayd+9eRo8ejUKh4NNPP8Xd3V28SxcEodlqFYm9rX938krPEuLVzm65LMtkFp0CqHG0N6hsLe/vHkG4Tyc0KqfLbptSUMawD363zae9eNMVRC40JFmWuemmmzh8+DB//fUXHTp0sA14JAiC0Fy1isReZiiib9SEKsuTcg/apmvqrlakz0ancSXIM6pW50wpKLNN69+YXstIhcakUCh44okniIuLo02bNo4ORxAEoV7UXE2lmcsrPcvv8Z9yPGNXlXXbTlQOCtPWv/tljyFJVjb9vYTNx79FlqVanXfuz5UjxD09ohNOorJck7F9+3amTp1KeXk5ANdeey3z5s3DyenyT2AEQRCaixaf2Pcmr6fUUEBm8Sm75WaL0TY94DKjscmyzMEzGyg1FODm5FWrynIAGcWVXewmdg6ve9BCg9mwYQN//fUX27dvd3QogiAIDaLFJ/aSijwAuoYNt1t+puBvADyc/S/Zxc1gLuOP+M85mvYnTmoXere5rlbnLDeaSSvWAzAkKuBKQxfqSUJCgm167ty5bNy4kXHjxjkwIkEQhIbTohO7LEsYzJWPXP3dI+zW7U1aB0B0QM9q95VkiY3Hviaz+DTeLkGM7/4Qrk6166b26Op9ACjrMOyr0DA+//xzBg8ezJo1awDQ6XT06NHDsUEJgiA0oBbdeC4l72i1yyVZwmipvKNuH9i32m0sVhM6jSuezv5M7Pl/KGv5CD67tIIl+yr7zb89qc8VRC3Up+HDh9OlSxdCQkIcHYogCEKjaNGJ3U3nDUBssP0Y6emFibZpF617tftq1TrGdL4Ls9VY66QO8MRP+23TDw+pftx3oeHo9XreeOMN7rrrLtq0aUP79u35888/az2wjyAIQnPXohO7v3sEA9vdSJS//eP2833XY4L6VbufyWKwjcdeU3/1f1pxKAWAjQ+OFcnEATZu3Mj7779PXl4e//3vf4Haj9YnCILQErTYxG4wl2O06OkQ1N9uudli5O+MHQBE+1eth28wl7P24Lt4uQQxtvNddUoKB9MKbNPDowKvMHKhrioqKlCpVGi1WiZOnMi7777L1KlTHR2WIAiCQ7TYxnN7k9ax+e9vSM0/Zrf8bOGFFtIBHvYN6iySmT8TlqE3lRDgEVHnO73JX24BoHOQJ0qluEtsDKdOnWLEiBG8+eabQOXd+YwZM3BxcXFwZIIgCI7RYu/Yk3IPAeDvZt+P/My5RN8r8toqfdLjkn8lqziJcJ+OdA8fVafzybJMQUVl3/j9T4y/wqiFugoMDMRkMmEwGBwdiiAIQpPQIhN7flm6bfqfA7ucT+xh3jF2yyVZIiXvKEqFimEdbqt1IZrzFm8+ht5kBUArKs01qLi4OIxGI4MGDcLd3Z1t27bh5iYG1xEEQYAWmtgTs/YCEB1g/w5dliUkuTL5+rjZd39Kzj1EhbmUmMB+aFR1G9lL8/S3SLIMwPRe1Y/5LtSPnJwcJkyYgL+/P/v27cPJyUkkdUEQhIu0yMReWpEPUKXhXJE+BwAPZ78q+ygVatr4daVjyKA6neuFXw/aknpsgAffTB98JSELNZAkCaVSSUBAAC+//DIdOnQQ9d0FQRCq0SITu4ezL5nFp/B2CbJbvubgOwC4OXlX2aetfzfaVjNe++XM/n4XX+yp7Dp3R+8oloikXu8sFgtvvPEGiYmJLFmyBIVCwb333uvosARBEJqsFpnYB7a7kYHtbrRbZrGabdP9oibarZNluU4t4C1WiahXV5N+rh48wNe31e1OX6gdpVLJvn37SE5OJicnh8BA0Y1QEAThclpkYpckK0rlhQZssizz/d5XAQhwj8TLJcBu3ZqD72CVLNzQ4//QqGt+vOv3wveUGiu/KEzuGs6qO4eLIij1yGQyceDAAQYMGIBSqeTjjz/G1dUVd/fqqwQKgiAIF7S4fuxJOYdYtX+xXf/15LwjmKyV3aH6tLXvipaQuYsifTa+bqG1Surr/06zJfUl0wfzw6wRIqnXs9tuu40bb7yRxMTK0r9BQUEiqQuCINRSi7tjzy5JQW8qJqvoNJG+nQFIyjkAQKBH2ypFaZLzDgPQJXRYjcded+wsk7/8E4BBbfy5o3dUPUYunHf33XcTHh5OcHCwo0MRBEFodlrcHXti1m4Au9btJkvl3fo/x1Mvqcgjt+Qs/u4R+LmH1XjshOwS2/Tv94+pj3AFID4+nlmzZlFRUQHA+PHjeeedd/Dw8KhhT0EQBOGfWlRiP9+dTaFQ2rq0VZjKyClNBcDT5UI3N1mW+SvxO2QkOoUMqfHY5UYzc36uvPNfc89IXLQt7mGHwyxfvpy1a9fy22+/OToUQRCEZq9FZaeT5wrTXNx//Wjan7ZpJ/WF+uFmqxGdxo1I38616ubm8fxy2/SQtgGX2VKojbS0NMLCKp+SPP/884wZM4YRI0Y4NihBEIQWoEXdsVtlCwBBnpXvviXJyt8Z2wEY3M5+tC+tWsfYzncxPHZ6jcddffSMbfrYszfg5Vy3ynSCvRUrVtC7d29+/vlnAFxcXERSFwRBqCct6o69Z+Q4OocOw0Vb+W42o+ikbV27wD7V7qNUXLquu8FsxXXO/2zzAyP9iQ30rKdoW68ePXoQGhqKs7Ozo0MRBEFocVrUHbtWpcPNyQuVsvL7ysns/UDlo/mLu6Sl5sXz29FPyStNu+zxxn2y0TY9JiaY9ffVbcQ3oZLFYuG9997j7NmzAHTo0IG9e/cyapS4noIgCPWtRSX23+M/w2ipbFltkcyk5scD0C6wt20bWZY5fHYzWcXJqC8z2EtGsZ7tyZWN8X68awS/3z9GPIK/Qr///jsLFy7kX//6l22ZWt2iHhYJgiA0GS0qsWcVJ7Hr1E8ApBUcty33d7/Qdz239AwF5Rm08etqV4HuYharRPhLP9jmJ3UJr3Y74dKsVitmc2Uhn+uvv55XXnmFN99808FRCYIgtHwtJrEbLZV129MKEwA4fGYzAD0i7PubJ+dWFqRp63fplvB3frfDNn30mYmX3E6oXlpaGtdeey3/+c9/AFAoFDz00EN4e1cdfEcQBEGoXy0msRtM5QCEeLUjMWsPhfosAEK9O9i2kWSJk9n7cNF6EOYTW+1xDmcUsPxgCgBfTBtEpyCvBo27JfLw8CAzM5MzZ84gnxvSVhAEQWgcLeZFZ0lFLlD5Dj01r7JOvK9bKP7uFx6jZxSdxCKZaePVzdbA7mJr489y41d/2uZn9hElY2vr1KlTFBYW0rdvXzw8PPjzzz/x86s67r0gCILQsFpOYjfkAxDs1Y64lMoKZiNj77DbJtSrPX3bjifcp2OV/WVZtkvqGQtvQqkUg7vURmFhIaNGjcLb25vdu3fj7OwskrogCIKDtJjErlKqUSpUqFUaVEoVktWCm87+na5CoaRz6NBq95/9/W7btP6N6TipL92/XbDn7e3NM888Q0REhOibLgiC4GAtJrHHBg8kJrAfKGDXqdV4Otu3eD+VHYePazDerkEoFPZNC07nlfLl3lNA5eN3kdQvT5IkPv30Uw4ePMjHH3+MQqHg0UcfdXRYgiAIAi2k8ZxFMmMwl6FUqkjM3H1umenCequZ+PSt/B7/BaWGwir7/+9AMgAeOg2fTxvYOEE3cz///DObNm0iPT3d0aEIgiAIF2kRd+w7T/5AeuEJ+kdPIjn3CAA9I8ba1qfmH6VIn024T0fcdT5V9j9flO71Cb1QKVvEd516J0kSx44do2vXriiVSj766CO0Wi0BAWJAHEEQhKakRWSxvLI0jBY9bk7elBoLAAj0bGtbn1WcBFQm+4tLywJYJYkXf6vs297ez72RIm5+7rnnHsaNG8epU5WvLMLCwkRSFwRBaIJaxB27yWIAwN89jApTKYDdnXlJRR4KFHhWU2lu1eELI7cNbOPfwJE2X5MnT8ZsNuPh4eHoUIQmxGKxIEmSo8Oolslkqnkj4aqIa1w/lEplvZbZbvZ37JIsYTCX4ecWjlWqHLZVcdHHMpjLyS09i5vOu9q+69O/3QbAsyM746xpEd9z6sWZM2d47LHHMBgqvzRNmjSJpUuXirt0waa0tLTJ/mGPjo52dAgtnrjG9cdkMlFaWlpvx2uwTCZJEgsXLiQxMRGtVssrr7xCZGSkbf369etZsmQJKpWKmJgYFi5ciPIK3m/nlKQAlWVLy43FwIXx2KEysYd4tSfAI7LKvp/sOmGbfvm6HnU+d0v26aefsnTpUvr168ftt98OUOU1htB6WSwWVCoVLi4ujg6lWmazGa1WDNrUkMQ1rj9arRa9Xo/FYqmXO/cGu2PfuHEjJpOJFStW8NRTT/H666/b1hkMBt555x2++eYbli9fTllZGVu2bLmi85wfetXLJYADqb8D9gnIyyWA0Z3upEvYcLv9tpzK4qFVewC4oXMYalWzf3hx1UpKSmzTc+fO5YsvvmD69OkOjEhoqiRJEiP0CUI9UqlU9fZaq8GyWVxcHEOHVhaD6dGjB/Hx8bZ1Wq2W5cuX24qZWCwWnJycrug8XcKGMaX303QLH2UbprVDUH8AygyFyLKMQqFA+Y++60/+VDlWe5cgL5bPHHZF525Jfv75Z2bMmMHvv1d+OXJ1deXGG28Ud+mCIAiNoD7/1jbYV+6ysjLc3Nxs8yqVyvaYQalU2kqOLl26FL1ez+DBg2s85sVfDi4nL9VITsoejhvW46r0o43TEPvYTFaOZFb2Z39zYADxhw/V8lO1XBUVFWi1Wo4dOybKwTaCuLg4R4dw1aKjo21D8zZF5eXljg6hxRPXuP6YzWZOnz5dL8dqsMTu5uZm95/+z0d3kiTx5ptvkpyczPvvv1+rbytdunSxu7MvNxazNXE5MUH9iPDpxNHdK3HWuNO7d2/yytI4dshMoF8IvWN62x3H/4UVtulrhvS/mo/ZbMmyzLJlyxgxYgRhYWH07t2bkJAQBg0a5OjQWry4uDh69+5d84ZN2PlGc458x7pnzx4ef/xx2rVrB1QmmbCwMN566y3MZjNGo5E33niDjIwMrFYrwcHBzJkzB3//yt4v+/fv57///S8WiwW9Xs+UKVNs7UlqsmzZMr7//nvuv/9+rr/++ktu9+OPP5KUlMTTTz999R/4HIPBwDPPPEN+fj6urq688cYb+PhUrc9xntFoZNSoUdx1113ce++9QOXQyk8++STff/+9bbvvvvuOvLw8Hn30UYqLi3njjTdITU21XbuXXnoJd/cLXYLLy8txdXW9bKwFBQU8/fTTGAwGAgICWLRokV3Z6a1bt/LZZ58BlX+T4uLiWL9+PcHBwSxcuJC0tDTMZjMvvPAC3bpdeqjtlsBkMtG1a1e73ymj0VjrG9qLNVhi79WrF1u2bOH666/n0KFDxMTE2K1fsGABWq2WDz/88IoazUHlaG3ZJcnoNC54uQQC2EZzOz/uuq9biN0+RzMLKdBX/lFKnDvpis7bEmzYsIH/+7//Y+LEiSxZsgTgil+HCMKz6+JYdTi1Xo95U/dIFk+8/BegAQMG8Pbbb9vmn3rqKTZv3syQIUN45JFHuPvuuxkzZgwAO3fu5P7772flypVkZGTwyiuv8Pnnn+Pn54fBYGDmzJmEh4czbFjNr+Y2bNjA4sWL6dChQ43b1rfvvvuOmJgYHn30UX7++Wc+/PBD5s+ff8ntf//9d66//npWr17N3XffXau/t08++SS33norY8dWFvr6+uuvWbBggd21ro0PP/yQCRMmMGXKFD799FNWrFjBrFmzbOuHDRtmu96ff/45vXr1Ijo6mvfff5/27duzePFiEhISSEhIaPGJvT41WGIfO3YsO3bs4NZbb0WWZV577TXWrVuHXq+nS5curFq1ij59+nDnnXcCMHPmTNsPUW2dLTgOQJBnNJlFlYVTtGpn9KYSjqVvQ6dxpa1/D9v2f53OZtSHf1Tu4+5MO7/W1SdblmUkSUKlUjF27FieffZZ7rjjjpp3FIRmwGQykZOTg6enJ8ePH8fd3d2W1AEGDRpEREQE+/btY//+/UyePNn22kmn0/HFF19UaeWflpbGvHnzsFgsKBQK5s+fz+HDh4mPj2fevHm8/fbbhIdX3kwYDAbmzp1LRkaG7S7zYv/+97+Jj4+nvLyc6OhoFi1aRFxcHG+88QZqtRoPDw/eeustcnNzmTt3Lmq1GpVKxeLFiwkMDLQdJy4uznbnPWzYMD788MPLXpeVK1cyb948CgoK+Ouvvxg5cuRlt09PTycvL8/u7/GMGTOYOnWq3XYHDx7kk08+sVs2a9YsRo8ebRfr/fffb4v1P//5j11iPy8rK4s1a9bwww8/ALB9+3auu+467rnnHlxdXXnxxRcvG7Ngr8ESu1Kp5KWXXrJbdnG/x4SEhKs+x5n8ynHXgzyjOHRmAwABHpG2evHtAvqg01x4VHQ+qQOcaGV36zk5OTz66KP069ePp556CoVCwZw5cxwdltBCLJ7Yu8a764awe/duZsyYQX5+PkqlkltuuYWBAweyevVqW8K9WHh4OBkZGeTk5BAbG2u37uLHzOctXryYGTNmMGbMGI4fP87zzz/Pjz/+yPr161m4cKHdOZYvX05oaChvv/02J06cYOfOnbaCTmVlZXh4ePDVV18hSRLjx48nOzubjRs3MnbsWO655x42b95MSUkJO3fupHPnzsyZM4f9+/dTXFxsl9jLyspssbq6ul62/3NKSgoVFRXExsYydepUvvzyy8smdoVCQU5ODmFhYXbLVSpVlevTs2dPli5deslj1SXWr776ilmzZtkeQxcWFlJSUsIXX3zBTz/9xBtvvMHixYsvey7hgmbbx0uWZdu0t2sQ+nMV5wI921JhLkOl1NAt3P4HWH1ufHXTm7fj6qRpvGCbAK1WS3x8PPv27bO7doLQnA0YMIClS5eybNkyNBqNLSEFBARUO0BRamoqwcHBhISEkJWVZbcuISGB48eP2y07ffo0ffv2BaBjx45V9rlYUlISPXr0ACAmJsbuztTJyYmCggKefPJJFixYgF6vx2w288ADD1BQUMCdd97Jb7/9hlqt5qabbsLb25t7772XZcuWoVLZjzZ5cful8vLyy1aDXLlyJRUVFdxzzz188cUXxMXFkZqaik6nq1JcSK/X4+TkVO21MZvNrFu3zm7ZwYMHmTFjht2/TZs21TlWSZL4888/GT9+vG2Zl5cXo0aNAmDkyJFX9J65NWu2ib1InwOAv3sEACZLBQCuTl4MajeF6QNeRKvW2ba3WCUsksyASL9WM9BLZmYmR45UDorj5eXF77//znfffSe6sAktjre3N2+++Sbz588nJyeH7t27/397dx4f073/cfw12TdZEESJEBIuVU01WlttqdivLZJIXFujtLHWnsSWxBLqErVdsVNEQ+1XiVJLaqe0KSVcWsSSIBlJJjPn98f85tQ0i1DJZOL7fDw8KrOc851v8ZmzfD9vHjx4QGJiovyaI0eOcPPmTby9vencuTPx8fE8eqTNlsjMzCQiIoLU1FS97bq7u3P6tHZp7C+//FLoihF3d3d++uknAG7dusWYMWP09n3nzh2+/PJLRo8eTVZWFpIksXPnTrp37866deuoU6cOW7Zs4eDBg7z33nusWbMGX19fVqxYobcfLy8vDh8+LG+3oBsxc3Nz2bNnDxs2bCAuLo64uDhCQkLYuHEjFSpUIDMzU85+UKvVHD9+nLfffpvKlSvj5OTEgQMH5G2tXbtW72f484j9+V/Pn4Yv6livXLlCzZo1sbL689/r9957T37fqVOn5BskhaIx2g4TdlaOdGw4FHNT7Q1fao0aADMT7ZH4X9vHjt91FoBb6coSHKXhPHnyhJYtW2JnZ8fRo0extbXNc3pNEMqS2rVrExwcTGRkJDNnzmTp0qVER0fL14GrVKnC8uXLMTU1pVq1aowdO5bPP/8cU1NTMjMz6dWrFx99pN/Iaty4cYSHh7Ny5Upyc3OJiooqcP/+/v5MmjSJoKAg1Go1kyZN4urVqwA0bNiQxYsX4+fnh4WFBdWrVyc1NZW3336bCRMmYGNjg7m5OdOnT0eSJMaOHUtsbCwmJiZMnDhRbz8BAQGMHz+egIAAzM3NmTdvHqDtFlm3bl35ZrTExETq16+Po6Oj/N4ePXrQrVs3Ro4cycyZM5k0aRImJiaoVCratm3LBx98AGgvQUyfPp2VK1eiUqlwdXUlMjLypf+fDB06lPHjx7NlyxacnJzksc6ZMwdfX18aNmxISkpKnssmQ4YMISwsjD59+mBmZsbs2bNfet9vMoVkBOdldbf8/3W5m86Vu6c4/ts32Fo64Fq+PvbWztSrqp+r7h6VwI1HmfzH70MGNnkzvv3FxMRQoUIF+vfvX6Q7YcvCMixjUBbmuTQsdytMUZZilTUHDx7ExsaGDz/88MUvfg3exDkuTvn9nXpR7SuI0R6xpytTsbGwx9zUkuO/JQBQxb4Wv9w5TmX7mnqF/dKdNG480l7n+djTxSDjLW6SJPHNN99w7NgxeUnK2LFjDTwqQRBKSr169ahateqLXyiUeUZ7sfnqvVNsTJr6/+vVtScdnGy1RdvFUT91qPuq7+XfV3Msm98wJUkiLi6O+Ph4bty4YejhCIJQwkRRF3SM9oj98u/auNWHmX8AYGlmy693kzAztaCei373tBpOtlx/mEHqdL8SH2dxkiSJGzduULNmTUxMTFiyZAmSJOHm5mbooQmCIAgGYrRH7KC9s1u3Zt2tYgOeZj2iin0tLM3zj5J0si6d1wNf1ejRo2nRogUpKSkAuLm5UbNmTQOPShAEQTAkozxi12jUgIS1RTme/f/6dXtr7TKUiuX07/xekXSVQ7/dK+khlojmzZvz66+/vnJLXkEQBKHsMcqK8CBDm8EuSdrsWkszG8rbulDX5UOql/+H/LqnWSqGxGuP6OtXccDExLjXbz948ICIiAiys7MB7dKVXbt2UaNGDQOPTBAEQSgtjPKIPTv3GRZm1lia2ZKlyqRxzY64ONbGxVF/GVvNyAT596dHdfrrZozOwoULWbRoETVq1GDQoEEoFArRbEZ4YxWW7gbaZLGymO6m891337Fv3z55bXhBiivdrShEupthGGVhr16+Lj3fG8sPV7bw+FkqTjaV87zmaZaKtGfadYH7h7TDwsw0z2uMwfNrRceNG4ebm5scnCMIpcWplD3ceHDxtW7TrWJD3q9ZcNGENzPdDSAyMpKjR49Sr169F75WpLu9eYyysIM2xe12mjZIxs6qAv/9aQUV7N6icc0OADzJVgHgYm9NWw/jXLt++PBhhgwZwqJFi2jXrh12dnYMHDjQ0MMShFLpTUl3A22r1nbt2rF58+YXzotId3vzGGVhP/5bArlqlfzz/x5e5s7j37Cy+HONerOFewHwdi24t3NpV6FCBZRKZb5hFoJQmrxfs+MLj66Lw5uY7gbQsWNHfvzxxxfOj0h3ezMZ5c1zKfcvcv3+OQCql6/H/x5qk3/qVG4MgEqtkXvCD23qYZhBvqJ9+/bxxx/atfkNGjTgp59+EqfeBaEAb2K628sQ6W5vJqMs7Cp1lvz7CrZv8XvaFeytKuLioL2Jpv2yP1OIfDyNpxvTkSNHCAwMZPz48fJjDg4OBhyRIBiHNyndrahEutuby+hOxas1uXo/Z+VmIiFR2cGN3x48pe6sb+Xndg5uU9LDeyWSJKFQKGjRogVDhw4lKCjI0EMSBKPzpqS7FUSkuwk6RpfupjCV2Jg0FROFKRpJTVVHD/5Iv0KzOoOoOydJfk+jqk6cGdPZgKN+sSdPnjBx4kQ8PDwYMWKEoYdTJlLHjEFZmGeR7lb6iHQ34/ZGp7s9U2lvvtBIauytKtLmH8H8kXaFtWefya/5Y2ovKpezLmgTpUZubi4HDx7k2rVr8pGDIAjCqxDpboKO0V1jV6CQu8tl5yoxMzHHtUJ9rj3QFvxFPb1LdVF/8uQJycnaZXrly5dnx44d7Ny5UxR1QRD+FlHUBR2jK+z21hWpbO8GQKVyrjx59hBJ0rD7Z+0dsB/WcDbg6AqXmZlJixYtCAoKQqnU3rXv4eGBubm5gUcmCIIglBVGV9glSYNKre2VnqZMJeFMDDm5WbjYa4/S36nqZMjhFcrW1pZevXrh5+cnirkgCIJQLIzuGvvJlN387+FlADKyH+HiWJs7TzVcupuOk7VFqeudfujQIQ4ePCjfUfrXblSCIAiC8DoZXWH/5Y9jej+/5ejBrsvatDddb/jSQpIkZs2axblz5+jXrx8eHsbVLEcQjN3nn3/OokWLDD2MYldYII6FhUWxBuKUhAsXLtC3b182btwo94zPL2Bn1KhR+Pv706RJE65evUpMTAzPnj1DqVTy0UcfERoa+tIHf+fPnycqKgpTU1M5g+B5T58+ZdSoUTx79gxzc3NiYmJwdnYmODhYfs3169fp3r17sYQB5ceoCvvzbWR1rC3sGLH9FAAbg1qU9JDyde/ePSpXroxCoeCrr74iMzNTFHVBMIA3oajrFBSI0759+2INxCkJ8fHxDBgwQK+wF+bJkyeMHj2a2NhY3NzcUKvVjBgxgk2bNhEQEPBS+54yZQqxsbFUr16dkJAQLl++TP369eXnExIS8PDwYNy4cWzZsoW4uDgmTJggt9u9desWI0aMYOjQoS/3of8GoyrsV+6dzPNY2rM/P0Kr2nlT3kra9OnTWbFiBT/88AM1atQQHZOEN0b8qVn5Pt7grY+oV1W7tvrIr5u59yQlz2ucy7nSqm4gAFfunuTCrUR6vz+h0P0lJCRw6NAhsrKyuH//Pv369ePgwYNcvXqVESNG0KlTJ5o1a8axY8e4cOECUVFRSJJE5cqVmTt3Lp988glOTk48efKE5cuXM3nyZG7duoVarWbAgAF54lgzMjKYPHkyT58+JS0tjd69e+Pr60vfvn3Zs2cPCoWCadOmyWEzustvjo6OREdH8/PPPzN37lzMzc3x8/PDysqKDRs2yNtfsGABTk5OTJs2jUuXLlGxYkV+//13lixZgqmpKeHh4WRnZ2NpacmMGTNwcSk43Or5QJxLly69lkCcGzduEBYWhkqlwsrKiqioKGbMmEHHjh1p2bIlR44cYc+ePcyaNYvWrVtTq1YtXF1dOXr0KN9++y02NjasWLECMzMz2rdvX+TPk5mZSVJSErt376ZLly48evSI8uXLF/pn4+DBgzRp0gQ3NzdA2+t+9uzZee5tWr9+Pf/973/1Hps9e7a8wiAjI4OcnBxcXV0BaN68OSdOnNAr7B4eHly/fl1+vZmZflmNiopi7NixJbrm36gK+7Mc/QABMxNzRmy/CUCLWpVKxTI3T09PqlevLt/1LghC8cnMzGTlypXs3r2b1atXs2XLFn788UdWrVql13s8PDyc+fPn4+7uzoYNG7h27RoAXbp0wcfHh/Xr18ttaTMyMujRowcffPCBXgG5efMmnTp14uOPP+bevXsEBwcTGBiIp6cnp0+f5p133uHkyZNMnjyZwMBAoqOjqV27NvHx8axYsYKmTZuSnZ1NfHw8AEuXLmX58uVYW1sTERHB0aNHsbGxIT09na1bt/Lo0SM+/vhjQFtsgoOD+eijjzhx4gRz587Nk8NeUCDOnj17XksgzuzZswkJCaFly5bs2bNHXrabnzt37pCQkCDP6f79+/nnP//Jnj17iIuLY9q0aS/8PDp79uzBx8cHS0tLOnTowNatWwkJCSlw37ogm79+5vwKa1BQUKGdPjMyMrCzs9Pbxq1bt/Re4+TkxLFjx+jYsSOPHz/W+7KWnJxMZmZmiTUN0jGqwu5g7YyZqQW56hyqOtahanlfkr7R9oL+sltjg4wpIyODZcuWERoaioWFBX5+fnTv3r3UduQShOLyoiNsgJaefV74Go8q3nhU8S7SPnV55OXKlcPd3R2FQoGDgwPZ2dl6r3v48CHu7u4AeteOa9asCWjDXpo2bQpog0vc3d357bffiI2NBbRHuD169GDNmjXs378fOzs7cnO17a39/PzYtm0b9+/fp02bNpiZmXHt2jWmTZsGaANUdPvR/Re06Y3jx4/H1tZWDpB5PkimfPny1KpVC9D2U1+2bBkrVqxAkqR8V9XoTsWnpaUxcOBAORCncuXKBQbiNG3alNTU1HwDcSRJ0st7T0lJ4d133wW06XKZmZl6/eOfb2Lq5OSEk5N2hVLv3r2ZOnUqtWrVws3NDScnpyJ9Hp34+HhMTU0ZNGgQWVlZ3L17l8GDBxcYZGNlZUXVqlX5+eef9Z67desWd+/elUN94MVH7M+H2ED+QTaLFi1i8ODB+Pv7k5ycTGhoqByYs2PHDnr37l3gZysuRlXY3St5cfnuYXLVOZgoTNn1izbAoW4le7yqVTDImObPn8/8+fOxsbFh6NChKBQKUdQFoYQU9UaoSpUqcePGDdzc3Fi+fLlcYHXv14W9+Pj4kJGRwZUrV3B3d9eLJZ05cyaNGjUiMDCQpKQkOaTkww8/JCYmhnv37hEREQFoC7iuQJw5c4b79+8DYGKiXWH89OlTFi5cyPfffw/AgAEDkCSJOnXq8O232ryLx48fc+PGDQBq1arFwIED8fLy4tq1a5w6darAz6o7Su7Xrx/bt2/Hy8tLDsTRJaY9H4hTvXp1PvvsMzp27Ej58uXlQJzPPvtMr7DrQm6aNm3Kjh07uH//PhYWFvJne76Q6j4ngJubG5IksWLFCvn6dlE/z6+//oparWbLli3yYwMGDODQoUPUrVuXxYsXy61t09PTuXr1Ku7u7tSqVYtly5YREBCAq6srKpWKWbNm0bRpU73C/qIjdjs7O8zNzfnf//5H9erVOXr0aJ6b5+zt7eUzHLpwHZ2kpCQ++eSTArdfXIyqsD//l/jt6q04eUd7an7+P98v6C3FQqVSyd8wR4wYgY2NDQMGDCjRMQiCUHTTpk2TA0+cnZ3p378/a9eulZ/38/MjPDycgIAAsrOz+fzzz6lQQf9goXXr1kydOpWdO3fi6OiIqakpOTk5WFhY0L59e44fP06NGjUAmDp1KuPHj0etVgPa66zPJ8fZ2dnh5eVF9+7dsbGxwd7entTUVHr06MGRI0fw9/enYsWKWFlZYW5uzvjx45k6dSrZ2dlkZWUxefLkQj/v84E4CxcufG2BOBERESxZsgQrKyumTZvGw4cPmTRpEjt37pSvZ+enV69eLFiwQA6ZKejzjBo1ikmTJsl368fHx9OtWze9bfXu3ZsNGzawcuVKAgMDCQwMxNbWltzcXCZPniyfcp81axZhYWFIkkRmZiatW7cmMDCw0HnLz7Rp0/jiiy9Qq9U0b96cd955B4CBAweydOlSRowYQVhYGBs3biQ3N5cZM2bI771//7585qIkGVUITMVq1py8uYPMnHQAvjzuzuV7VuwLaVti8axnzpxhyJAhxMTE0Lp16xLZZ0kpC+EkxqAszLMIgSke165dIzk5mU6dOpGWlkbnzp05dOhQqZzn4pjjL7/8kk8//TTPjXtvgtcZAmNUneeO/raVzJx0FIr/P52Vpf1O4upUgncbmplx+/ZtOXdZEAThdXFxcWHXrl34+fkxePBgvvjii1JZ1IuLv7//G1nUXzejOhUvkwBM+f2JFd3fdsWzkkOx7i4pKQk3NzeqVKnCO++8w7lz5wpdaiIIgvAqbGxsWLJkiaGHYTAiyOb1MKojdh0JDSjKo5YUdKhXvH8QkpKS6NSpE2PHjpUfE0VdEARBKK2M84gduJtR9OsNf4e3tzdBQUEv3a1IEARBEAzBaAv7H0+1ywvecni912OePXvGzJkzqVKlCsOGDcPExIQFCxa81n0IgiAIQnExqlPxJgpTANrW+xf/+f/uso1f8/p1pVLJ5s2b2bBhg9yAQhAEQRCMhVEdsVcqV4Nbjy/xLNeeHLX2O0lFO6u/vd2srCzu3LlDzZo1qVChAvHx8bi7u+fp+SsIgmAM2rRpg4uLCyYmJqjVapRKJTNmzODtt99GkiQ2btzIrl275H/jBg8eLK9bf/z4MbNnz+bmzZtyEtz06dPzbTNrKN26dcPLy4spU6bIj+lyAXSe712fnZ3Nv//9by5cuIBCocDGxobp06e/9P1SWVlZjB07locPH2Jra8vs2bP12g7/8ssvREdHyz+fP3+er776imbNmjFz5kwuXbpETk4OoaGhxbpc2qgql0bSADBmx2kAvKoVHgRQFFlZWbRt25bc3Fy+//57rK2ti5QeJAiCUJqtXLlSXvv8ww8/sGjRIpYtW8bmzZs5e/Ysq1evxtLSkrS0NEJCQnBwcKBRo0aMHj0af39/fHx8AFi9ejURERF6yXGGdObMGTw8PEhKSsrTy70gUVFR1KpVi40bNwLw3XffMXLkSDZv3vxS+/7666/x8PAgNDSU3bt3s3jxYsLCwuTn69WrJ3cr3Lt3L5UqVaJly5YkJCSQm5vLpk2buHfvHnv37n2p/b4soyrs959qA18sTW4BDoxr0+Bvb9PKyopWrVqhUqkwgl49glBqlcZ0t/Xr17N//35yc3MpV64csbGxaDQaJk6cyB9//IFKpSI8PJyUlBS++eYbNBoNw4cP5/79+6xZswYLCwvc3NyYPn16vslgf9326NGj6devH97e3ly8eJElS5awcOFCpkyZws2bN9FoNIwcOZImTZrQuXNn3NzcsLCwYNy4cXIntvT0dD777DPatWvHoUOHWLhwIXZ2djg4OODp6UloaCjz5s3j1KlTSJJE//796dChQ6Fz9ccff8g9ztevX8/atWvlou/k5MTnn3/O119/jbOzMw8ePJCLOkBwcDA9e/bU255Go2HWrFn88ssvqFQqQkNDKVeuHJs2bZK/AOiOoCdMmEB6ejrp6enUrFkTb29vunfvzv379xkyZAgJCQkv9Xni4+Np3749Li4ubN++vdCWsKBt/JKYmCj37gfw8fGhcWP9fJGbN2/qFWmAzp0706fPn/kGZ86cYfDgwQC0bNmSxYsX57tPpVJJbGws69evB+Do0aN4eHgQEhKCJEmEh4cXOua/y6gKu6RdwM7Fu9q/YL3fqfFK2zl//jx79+5l4sSJAERGRha557QgCKVHYeluHTp0ID09ndWrV2NiYsKgQYP46aef+Omnn3jrrbeYP38+V65c4fjx49jb22Nvb8+SJUtIS0sjIiKCbdu2YWdnR3R0NJs3b9YrIBqNJt9t9+7dm23btuHt7c22bdvw8/MjPj4eJycnoqOjSUtLIygoiN27d6NUKhk2bBj/+Mc/OH78OAMGDKBJkyacPXuW2NhYWrduTWRkJJs3b6ZixYqMGTMGgMOHD3P79m02bdpEdnY2fn5+NGvWLE84ycCBA8nOziY1NZUWLVowfvx4ANLS0vLEnj6f9KYLj9ExNTXNcxr+4MGDcgrd/fv3Wb9+vRyik58PPviA/v37y+E43bt359tvv6VHjx5F/jygDd06c+YMkZGR1KlTh2HDhhVa2BUKBenp6VSsWDHPv/F/bfVao0YNvWyA/GRkZMhzYWtry9OnT/N93datW/H19ZXnOS0tjZs3b7Js2TJOnTrFxIkT9VLgXjejKuw69zMtqGj7asvdJEliwoQJnDx5kq5du1K/fn1R1AXhNSht6W4mJiaYm5szevRobGxsuHv3Lrm5uVy/fp2WLVtq9+XhgYeHBwkJCXIwzK1bt6hdu7Z8ivf999/n6NGjzJ8/n7NnzwLa09P5bbtFixbExMSQnp7O6dOnCQsLY8aMGZw5c4aLFy8CkJubS1paGvBn2puzszNLlixh69atKBQKcnNzefToEXZ2dnJOeuPGjXnw4AFXrlzh8uXLBAcHy9t7/ohcR3cq/ssvv+T27dty73s7OzvS09NxdHSUX3vz5k1cXFyoWrVqnqQ3lUrFvn376NKli/xYSkqKfMnS2dmZUaNG8eOPP+q97/kzoLrP6e7ujlqt5vfff2fPnj2sXr2azZs3F+nzgDYtTaPRMGTIEEDbi/3EiRN8+OGHef4dVyqVWFpa4uTkxJMnT5AkSe81O3fuxNfXVz4TU5Qj9ufT3vJLent+2wsXLpR/dnR0pFWrVigUCry9veVwn+JiVHfFA0gSPM025SP3yi/1vidPngDab3ALFixg27Zt1K9fvziGKAhCCSnsS3lycjIHDhzg3//+N+Hh4Wg0GiRJklPKQFvEdUfCukSyatWqce3aNZRKJQAnT56kZs2ajBo1inXr1rFu3TquXr2a77ZNTEzw9fVl6tSptGvXDlNTU2rVqkWnTp1Yt24d//nPf/D19cXBwUFvnwsWLKBbt27ExMTQpEkTJEmSk8IePdKmWF64cAHQJqM1adKEdevWsWbNGjp06JDnKPt5I0eOJDU1Vb6+HBQURGRkpNyb/OHDhyxatAh/f38qV66Mk5OTXhzr2rVr9X7WjeHy5cuANqlu0KBBWFpayklvv//+O48fP873/1OvXr2IiYmhdu3a2Nvbv9Tn2bp1K0uXLiUuLo64uDjCwsLkI99q1apx4sQJ+bU//PADb7/9Nubm5jRv3lzvaHzfvn2sWbNG7/KK7oj9+V/PF3UALy8vOdXvyJEj+WY+PH36lJycHL0b89577z35fcnJycXe5Mzojtg1EkgomObbqMjvWbhwIQsWLOD777+nevXqeHp64unpWXyDFATB4GrUqIG1tTU9evTAwsICZ2dnUlNT8ff3Z9KkSQQFBaFWq5k0aRJXr16V31e+fHlCQ0Pp168fJiYmuLq68sUXXxRp2wA9e/akXbt2cs63v78/YWFhBAUFkZGRQWBgoF6sKYCvry9RUVEsW7YMFxcX0tLSMDExITw8nE8++YRy5cqh0WioUaMGbdq04eTJkwQGBqJUKmnXrl2hN5CZmJgQFRVF3759adeuHcHBwajVavr27YuZmRkKhYJhw4bh5eUFwJw5c5g+fTorV65EpVLh6upKZGSk3jbbtm3LkSNHCAgIQK1W89lnn9GgQQPKlStH7969cXd3L7A46z6rrnVuQZ8nISEBgB49egDaWFhdtK1O+/btmTlzJnfu3CEyMpJp06Yxf/58NBoNjRo1kpPhJk6cyMyZM/H39wfAwcGB2NjYAuesIAEBAYwfP56AgADMzc2ZN28eAKtWrcLV1ZW2bduSkpLCW2+9pfc+Pz8/pkyZgp+fH5Ik6V3vLw5Gle6WnLWbLLWSkG/ro54XXOT3b9y4kZkzZ7Jq1ao8N0wIfyoLqWPGoCzMs0h3KxnLli1jwIABWFhY8MUXX9C8eXP++c9/GnpYQPHPcXJyMpcuXaJXr17Fto/S5I1NdwNIuuVA//fdC32NSqUiLi4OlUoFaL9lnThxQhR1QRCMiq2tLX5+fvj7+yNJEh07djT0kEqMo6NjnrvxhaIxulPxP9+347OWhV+fmDdvHnPmzEGpVBIaGopCoSjSWkdBEITSJCgo6IXLucqqKlWqGHoIRsvoCvtDpTmBXjXzPK7RaOTrVkOHDiUjI4N//etfJT08QRAEQXhpf71r/+8wulPx1hZ5Q1+Sk5Px8fHhyJEjgPbGiMjIyAKXIgiC8PeYmJiILAVBeI3UanWemypflVEdsWs0YGNRMc/jSqWSixcvcvjwYXl9qiAIxcfMzIxnz56hVCoxNTUtdb0gVCqVfDOSUDzEHL8ekiShVqtRq9WvLZ/EqI7Y1ZKCJb20rSmTk5Pl5SVeXl6cOHGi2Nv0CYLwp3LlymFhYVHqijrAtWvXDD2EMk/M8euhUCiwsLB4rSE7RnXEnqO2pGFVJ86fP4+vry8ff/wxa9euBaB27doGHp0gvHlKcwJiaV2KV5aIOS6diu2IXaPREBERQZ8+fQgODubmzZt6zycmJtKzZ0/69OnDli1birTNp9naiNaGDRvSqVMnAgMDX/u4BUEQBMGYFdvX7QMHDpCTk8PmzZs5f/48s2bNkjsNqVQqZs6cydatW7G2tiYgIIDWrVvj7Oxc6Db/dzoFfLU37sTFxRXX0AVBEATBaBVbYT9z5gwtWrQAoFGjRly6dEl+7tq1a7i6usr9kt977z1Onz5dYFSfrjne9dPXycjIyBOfKLw+2dnZhh7CG0HMc/ETc1z8xBwXL93NiS/bILbYCntGRoZeUxhTU1Nyc3MxMzPTi74DbXeljIyMArel6yA3NTyCX3/9tbiGLIDeFzCh+Ih5Ln5ijoufmOOSoVKpsLKyKvLri62wPx9vB9pr7robbf76XGZmZqF3BNra2uLh4YG5uXmpvANXEARBEF43SZJQqVQv3ZO/2Aq7l5cXhw4domPHjpw/fx4PDw/5OXd3d27evEl6ejo2NjacPn2aQYMGFbgtExOT17oUQBAEQRCMwcscqesUW7qbRqNh6tSpXLlyBUmSiI6O5ueff0apVNKnTx8SExP56quvkCSJnj170rdv3+IYhiAIgiC8UYwitlUQBEEQhKIxqs5zgiAIgiAUThR2QRAEQShDSl1hL46OdYK+F83xrl276N27N/7+/kRERKDRaAw0UuP1ojnWCQ8PZ+7cuSU8urLhRXN88eJFAgMDCQgIYPjw4WLN9St60Tzv2LGD7t2707NnTzZu3GigUZYNFy5cIDg4OM/jL133pFLmv//9rzR+/HhJkiTp3Llz0qeffio/l5OTI7Vr105KT0+XsrOzpR49ekipqamGGqrRKmyOnz17JrVt21ZSKpWSJEnSqFGjpAMHDhhknMassDnW+frrryU/Pz8pJiampIdXJhQ2xxqNRuratat048YNSZIkacuWLdK1a9cMMk5j96I/y82aNZPS0tKk7Oxs+d9n4eUtX75c6ty5s9S7d2+9x1+l7pW6I/aidqyzsLCQO9YJL6ewObawsGDTpk1YW1sDkJubi6WlpUHGacwKm2OAc+fOceHCBfr06WOI4ZUJhc1xSkoKjo6OrFmzhqCgINLT06lVq5ahhmrUXvRn2dPTk6dPn5KTk4MkSaLXyCtydXUlNjY2z+OvUvdKXWEvqGOd7rmX6Vgn5K+wOTYxMaFiRW3m/bp161AqlTRr1swg4zRmhc1xamoqixYtIiIiwlDDKxMKm+O0tDTOnTtHYGAgq1atIikpiRMnThhqqEatsHkGqFOnDj179qRTp060atUKe3t7QwzT6LVv3z7ftMRXqXulrrC/zo51Qv4Km2Pdz7Nnz+bYsWPExsaKb+CvoLA53rdvH2lpaYSEhLB8+XJ27dpFQkKCoYZqtAqbY0dHR2rUqEHt2rUxNzenRYsWov3pKypsnpOTk/n+++85ePAgiYmJPHr0iL179xpqqGXSq9S9UlfYvby8OHLkCEChHetycnI4ffo07777rqGGarQKm2OAiIgIsrOzWbx4sXxKXng5hc1xv379SEhIYN26dYSEhNC5c2d69OhhqKEarcLmuHr16mRmZso3ep0+fZo6deoYZJzGrrB5LleuHFZWVlhaWmJqakr58uV58uSJoYZaJr1K3Su2lrKvysfHh2PHjuHv7y93rNu5c6fcsW7ChAkMGjRI7lhXuXJlQw/Z6BQ2xw0aNGDr1q00btyYf/3rX4C2EPn4+Bh41MblRX+Ohb/vRXMcFRXFmDFjkCSJd999l1atWhl6yEbpRfPcp08fAgMDMTc3x9XVle7duxt6yGXC36l7ovOcIAiCIJQhpe5UvCAIgiAIr04UdkEQBEEoQ0RhFwRBEIQyRBR2QRAEQShDRGEXBEEQhDKk1C13E4Sy6Pbt2/j6+uLu7q73+NKlS3Fxccn3Pbr2kqGhoa+834SEBGbNmiXvIysrC29vb6ZMmZJvl6vCLFiwgAYNGtC2bVuCg4NZt24dAN26dePbb7995TECBAcHc/fuXWxsbABtt63q1aszd+5cuRNifrZs2YKNjQ2dO3f+W/sXhLJEFHZBKCGVKlX62wXwVbRp04ZZs2YBoFar8ff3Z+vWrfj7+7/UdkaMGCH//uTJk/LvX9dnioyMpEmTJoC2u9nw4cNZtWoVY8eOLfA9Z8+exdvb+7XsXxDKClHYBcHArly5wowZM1AqlTx69IiQkBACAgLk51UqFZMmTeLq1asABAYG4ufnx4MHD4iIiODu3bsoFArGjBlD06ZNC92XqakpjRs3lrf1zTffsGrVKhQKBfXr1yc8PBwLC4t89zdhwgS8vb35+eefAejduzfx8fF4enpy+fJlWrVqxfbt26lYsSLp6el07tyZQ4cOceLECRYuXEhubi7VqlVjxowZODk5FTpOpVJJWloaDRs2BGDv3r2sWrWKrKwscnJyiI6OJisri8TERJKSknB2dqZevXovPR+CUBaJa+yCUEJSU1Pp1q2b/GvFihUAxMfHM2zYML755hvWrl3LnDlz9N537tw5Hj9+zPbt21m2bJmc7BQVFUXPnj1JSEhgyZIlREREvDAcIi0tjaNHj9KoUSN+/fVXli5dyrp169i5cyfW1tYsWrSowP3phIWFyePWMTMzw9fXl3379gGwf/9+fHx8ePr0KfPmzSMuLo7t27fTvHnzAvPnw8LC6Nq1K82bN6dPnz40bdqU/v37o9Fo2LRpE0uXLmXHjh0MHjyY5cuX07RpU9q0acPw4cNp0aLFK82HIJRF4ohdEEpIQafiJ0yYwA8//MCyZcu4cuUKSqVS7/k6deqQkpLCoEGDaNmyJePGjQPg+PHjXL9+nYULFwLaiN1bt25Rr149vfcnJibSrVs3JElCkiR8fHzo3LkzGzZsoHXr1vLRc58+fZg4cSIhISH57u9FunbtysyZMwkKCmLXrl2MGjWKCxcucOfOHfr16wdoT7E7ODjk+37dqfizZ88yfPhwfHx8sLCwAOCrr74iMTGRlJQUTp48iYlJ3mOSos6HIJR1orALgoGNHDkSe3t7WrduTceOHdm1a5fe805OTuzevZtjx45x+PBhunfvzu7du9FoNKxZswZHR0dAe0agQoUKebb//DX252k0Gr2fJUkiNze3wP29SMOGDXn8+DEXL17k3r17vPvuuxw4cAAvLy+WLl0KQHZ2tl5SVX68vLwIDg5mzJgxbNu2jezsbHr16kXXrl15//338fT0ZMOGDfl+nqLMhyCUdeJUvCAY2LFjxxg+fDjt2rWTU7TUarX8/MGDBxk7diytWrUiLCwMGxsb7ty5wwcffMDGjRsB+O233+jSpQvPnj0r8n69vb1JTEwkPT0d0N5h3qRJkwL397y/ZnLrdOnShSlTptCpUycA3nnnHc6fP09KSgoAixcvznOpIT8DBgwgMzOTzZs3c+PGDRQKBZ9++ilNmjThu+++k+fH1NRU/v3fnQ9BKCvEEbsgGFhoaCiBgYFYWlpSt25d3nrrLW7fvi0/37JlS/bv30+nTp2wtLSka9eueHp6EhYWRkREBF26dAFgzpw52NnZFXm/devWZciQIQQHB6NSqahfvz7Tpk3D0tIy3/09r23btnTr1i1PjnzXrl1ZsGAB8+fPB8DZ2Zno6GhGjhyJRqOhcuXKxMTEvHBsFhYWjBw5kujoaL777jvq1atHhw4dUCgUNG/enDNnzgDQtGlTvvzyS8qVK/e350MQygqR7iYIgiAIZYg4FS8IgiAIZYgo7IIgCIJQhojCLgiCIAhliCjsgiAIglCGiMIuCIIgCGWIKOyCIAiCUIaIwi4IgiAIZYgo7IIgCIJQhvwf6UIrnRCkgCYAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 576x396 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plot_model(tuned_rf, plot = 'auc')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "bwyoTUDQEQrm"
   },
   "source": [
    "### 10.2 Precision-Recall Curve"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "4IvchQoiEQrr",
    "outputId": "fdff2076-86fc-42f5-beee-f0051ea30dd4"
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAfYAAAFlCAYAAAAZGcpRAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy86wFpkAAAACXBIWXMAAAsTAAALEwEAmpwYAABYTElEQVR4nO3dd3gU1dvG8e9sSaeFEnoLhCJNeguCFGnSIRClWcAGFpAiUkSa4msBBLsCKoIUaQLSQQSEUCO9dwgQIH13Z877x8L+iLSALJtsns91ecnOzs48e7LJvWfKOZpSSiGEEEIIr2DydAFCCCGEeHgk2IUQQggvIsEuhBBCeBEJdiGEEMKLSLALIYQQXkSCXQghhPAiFk8XINKHU6dO0bhxY8LCwlzLlFJ069aNDh06PJR9fPbZZxQpUoQ2bdrccZ3WrVszffp0smbN+lD2+eSTT2K1WvHz80PTNGw2GyaTiQEDBlCvXr2Hso+blSpVio0bN7JmzRqWLVvGl19+ecs6KSkpTJkyhTVr1qCUwjAMnn76aV588UU0TXvoNd3Nn3/+ydChQ8mZMyc//vgjfn5+972NzZs38+KLL1KsWDHXsoSEBEqUKMHYsWPJkSPHQ6l15MiR5MiRgz59+jyU7ZUqVYqwsDBMpv/1b8qVK8fo0aMfyvbvZNeuXcyePZuRI0cCoOs606ZNY+HChei6jt1up0GDBrz++uv4+PgwaNAgSpYsyfPPP//Qali5ciUbN27k3XffZe/evfTp04esWbPSpk0bTpw4wbvvvvvQ9iUePQl24eLn58f8+fNdj8+fP0/Lli0pV64cpUuX/s/bf/311++5zs37f1g++ugjypcv73q8dOlS3nnnHf7888+Hvq97UUrxyiuvUKxYMWbOnImvry+xsbH07t2bxMRE3njjjUdaz+LFi+nYsSOvvPLKf9pO4cKFU/3sdF2nT58+fPfdd/Tr1++/luk2U6dOJTg4+JHu89ChQ5w/f971eMSIEVy9epWpU6eSJUsWEhMT6d+/P0OGDGH8+PFuqaFhw4Y0bNgQcIZ8jRo13P6FRjw6EuzijkJCQihSpAjHjh1jz549zJ49m6SkJIKCgpg+fTq//vorM2bMwDAMsmfPztChQwkNDSUhIYFRo0axbds2zGYzjRo14s0332Tw4MGunseECRNYvnw5VquVHDlyMHbsWPLkyePq8QYHB/P555+zePFizGYzxYoVY+jQoeTOnZuuXbtSqVIltm3bxtmzZ6lVqxbvv/9+qp7XnSilOHXqFNmyZXMtu9/3cezYMUaOHElCQgIxMTGULl2aTz/9FF9f33vuf8uWLRw5coSvvvoKs9kMQI4cOfjwww85ffo0AF27duWZZ56hadOmtzwuV64cDRs2ZN++fXTo0IGoqCi++OILAA4fPkyPHj1Ys2YNx44dY/To0Vy5cgVd1+natestR16++eYbVq5cia+vL3Fxcbz11luMGzeOjRs3YjabqVChAoMHDyYoKIgnn3ySChUqsH//ft566y0aN2581/cZHx/P5cuXqVy5MgA7duxg/Pjx2Gw2YmJiqF27NmPGjOHUqVP06NGDJ554gp07d3Lt2jXefvttGjduTHx8PEOGDGHfvn3kyZMHs9lMlSpVADh48CAjR47kypUraJrGc889R5s2bdi8eTMff/wx+fLl4+jRo/j7+9OrVy+mT5/O0aNHadKkCe+88849f05bt27lww8/JCkpCavVyhtvvEG9evWYO3dumn8Ptm7dyrhx4zAMA4DevXtToUIFJkyYQFxcHIMHD+bVV19l4cKF/PnnnwQFBQEQEBDAe++9x7Zt226pa/bs2cycORO73c7Vq1d58cUXiYyMJCYmhoEDBxIbGwvAE088wRtvvHHH5XPnzmXZsmW0aNGCGTNmoOs6ycnJ1KlTx3WkKS4ujtGjR3PgwAHsdju1atViwIABWCyWVJ/Df39xFumAEkIpdfLkSVWpUqVUy7Zt26aqVaumzpw5o+bMmaOqVaum4uLilFJKbd68WUVGRqrExESllFLr169XTZs2VUopNWbMGPXmm28qh8OhUlJS1DPPPKM2bdqkBg4cqL755ht15swZVblyZZWSkqKUUurbb79Vy5cvV0opFRYWpi5duqRmz56tIiIiVEJCglJKqQkTJqjnnntOKaXUs88+q/r27at0XVdxcXGqbt26auPGjbd9Xw0aNFBNmjRRTz/9tAoPD1fh4eFq8ODB6sSJEw/8PsaNG6d+++03pZRSNptNtWzZUi1dujRV/XPmzFG9evW6pZ5vv/1W9e3b964/i2effVYtWbLkto/DwsLUvHnzlFJKxcXFqapVq6oLFy4opZT68MMP1ccff6zsdrtq3ry5io6OVkopde3aNdWsWTO1ffv2W/Z142eilFKfffaZeu2115TNZlO6rqtBgwapoUOHutpx0qRJt61306ZNqnz58qpVq1aqefPmqmbNmqpNmzbqyy+/VDabTSml1Jtvvqk2bdqklFIqPj5e1ahRQ+3evVudPHlShYWFqVWrVimllFq6dKmqX7++Ukqp0aNHqwEDBijDMNSlS5dUvXr11IQJE5TdblcNGzZUy5YtU0opde7cORUeHq62bdumNm3apMqUKaP++ecfpZRSzz//vIqIiFApKSnq0qVL6rHHHlPnzp1ztWXLli1Vq1atXP9dvHhRXb58WdWqVUvt2LFDKaXUgQMHVPXq1dWJEyfu6/egW7duatGiRUoppfbu3atGjBihlFKpPhtLly5V7du3v8un4X8/o/j4eNWpUyd1+fJlpZRS27dvd/3OTpo0yfWzSkhIUG+88Ya6du3aHZffXMOECRPUe++9d0ttgwYNUtOmTVNKKeVwOFT//v3VV1995Wq7G59Dkf5Ij124JCcn07p1a8B5KDVHjhyMHz+efPnyAc5zkjd6FWvWrOH48eN07tzZ9fpr165x5coV/vrrLwYPHozZbMZsNvPjjz8CMG/ePMB5JKB06dK0bduWevXqUa9ePWrVqpWqlnXr1tGuXTsCAgIA6NatG1988QU2mw2ABg0aYDKZCAoKokiRIly9evWO7+tGj+LkyZP07NmTMmXKUKhQoQd+H9WqVWPDhg18/fXXHDt2jAsXLpCYmJimNjaZTKj/OIpz1apVAQgKCqJx48YsWLCAHj16sHDhQn766SeOHTvGiRMnUvVMk5OT2bNnD5UqVbrjdtetW8ebb76J1WoFnEcKXn311Vv2ezs3H4qfM2cOn3zyCc2aNXNta9y4caxbt44vvviCI0eOkJKSQmJiItmzZ8dqtfLEE08AULZsWa5cuQLAxo0beeedd9A0jeDgYNdRgmPHjpGSkkKTJk0A5+epSZMmrF+/nho1alCwYEHKli3rqitLliz4+PgQHBxMYGAgV69eJSQkBLj9ofi1a9dSuHBhKlasCEDJkiWpXLkyf//9N5qmpfn3oFmzZowcOZJVq1ZRu3Zt3nrrrVvazWQyuXr09xIYGMgXX3zB2rVrOXbsGPv27XN97sLDw+nVqxdnz56ldu3a9OvXjyxZstxxeVqsWbOG3bt3M3v2bMD5GbrZ3T4PwrMk2IXLv8+x/9uNkAUwDIPWrVvz9ttvux5fuHCBbNmyYbFYUl0Edvbs2VQXZZlMJn788Ud2797Nxo0bGTNmDOHh4QwYMCDV9m/ehmEYOByOVLXeoGkaSilmzJjBL7/8Atz+IqhChQrx4Ycf0q1bNypWrEiFChUe6H2899576LpOs2bNqF+/PmfPnk1zWFesWJGpU6ei67rrUDw4L6iaPn2665zqzduz2+2ptnHzz6FTp06uQ7+hoaEUKlSI/fv3kyVLllQ/y4sXL97zD/rt2vzmfd+837tp3749O3fu5PXXX2fWrFlYLBaeffZZSpUqRXh4OM2aNWPnzp2u92i1Wl2nUf598eDN7XCjvXRdv+16Nz4fPj4+qZ6zWO7vz9zdtm+1WtP8e9C5c2caNGjAhg0bWL9+PZMmTWLp0qWptluhQgWOHDlCfHy868sCOK9vGTp0KBMmTHAtO3fuHBEREXTq1IkqVarQtGlTVq9e7drOjQviNm3aRMeOHfn666/vuDwtDMPgs88+IzQ0FHB+Ybm5XdL6eRCPntzuJh5I3bp1Wbx4MRcuXABgxowZdO/eHYBatWoxb948DMPAZrPRt29ftmzZ4nrtvn37aNmyJaGhofTu3ZsePXqwe/fuVNsPDw9nzpw5rh7J9OnTqVat2i1/tG/WpUsX5s+fz/z58+94IVDlypVp06YNI0aMwDCMB3off/75J6+++irNmzcHYOfOnei6nqZ2e/zxxylevDhjx44lJSUFcIbuqFGjKFiwIADBwcFER0cDzgut9u/ff8ft3eiBf/7553Ts2BGAYsWKpfqSdvbsWVq2bOna5p2Eh4czY8YM7HY7hmHw008/UadOnTS9r3/r378/Z8+e5aeffuLatWvs3r2b/v3706RJE86dO8eJEyfu2VMNDw9n9uzZGIbB1atXWblyJQDFixfHYrHwxx9/AM4QXLZsGbVr136gWv+tUqVKHDlyhF27dgHO8/lbtmyhevXqt6x7t89P586d2bt3L+3ateP999/n2rVrxMTEYDabXV9CQkJCePrpp3nnnXeIj48HnNcnjBgxguzZs6f6AhsdHU1wcDCvvPIKdevWdYW6rut89NFHTJ48mUaNGjFkyBBKlCjBwYMH77g8LerWrcsPP/yAUgqbzcbLL7/sOmol0jfpsYsHUrduXV588UWee+45NE0jKCiISZMmoWkar732GqNHj6Z169bouk7z5s1p0qQJq1atAqB06dI0a9aM9u3bExAQgJ+f3y2313To0IGzZ8/SsWNHDMOgSJEifPTRRw+l9rfeeotmzZoxa9YsOnfufN/vIyYmhldffZWAgACCgoKoVq0aJ06cSPP+J0yYwCeffEK7du0wm80YhkGbNm1ctzO9/PLLDBo0iLVr11K8ePF7HvLs2LGj6483OHuskydPZvTo0XzzzTc4HA5ef/1114Vnd/Lyyy/zwQcf0KZNGxwOBxUqVGDo0KFpfl83y5o1K/3792fs2LG0aNGCXr160bZtWwICAggJCaFy5cocP37cdUrkdvr06cPw4cNp1qwZwcHBrlsxrVYrkydPZtSoUUycOBFd13n11VepWbMmmzdvfqB6bxYcHMxnn33G+++/T3JyMpqmMXbsWIoVK8b27dtTrXu334P+/fszZswYPv30U9fnqWDBgui6zueff85rr73GpEmTGD58OJMnT6Zz586YzWZsNhuNGjW65ba+OnXqMHv2bJo2bYqmaVSvXp3g4GCOHz9O9+7dGTRoEC1btsTHx4dSpUrRokULrl69etvlixYtumc7DBkyhNGjR/P0009jt9upXbs2L7zwwn9uX+F+mvqvJ/yEEEIIkW7IoXghhBDCi0iwCyGEEF7ErcG+c+dOunbtesvyVatW0b59eyIiIpg1a5Y7SxBCCCEyFbddPPf111+zYMEC/P39Uy232+2MHTuW2bNn4+/vT5cuXWjQoAG5c+d2VylCCCFEpuG2YC9cuDATJ05MdW8yOIe9LFy4sGtIzypVqrB161aaNWt2x20ZhkFCQgJWq/WRT5IhhBBCeIJSCrvdTmBgYJqGzL7BbcH+1FNPcerUqVuWx8fHpxooIzAw0HX/5p0kJCRw4MCBh16jEEIIkd6FhYWlecRA8MB97EFBQSQkJLgeJyQk3LPgG8NSrr4IfeqXc2t9mVl0dDTlykn7upu0s/tJG7uftLH72Ww2Dhw44MrAtHrkwR4aGsrx48e5cuUKAQEBbN269Z7zDN84/J5kkKYZtMSDk/Z9NKSd3U/a2P2kjR+N+z0F/ciCfeHChSQmJhIREcGgQYN4/vnnUUrRvn1714QMQgghhPhv3BrsBQsWdN3O9vTTT7uWP/nkkzz55JPu3LUQQgiRKckANUIIIYQXkWAXQgghvIgEuxBCCOFFJNiFEEIILyLBLoQQQngRCXYhhBDCi0iwCyGEEF5Egl0IIYTwIhLsQgghhBeRYBdCCCG8iAS7EEII4UUk2IUQQggvIsEuhBBCeBEJdiGEEMKLSLALIYQQXkSCXQghhPAiEuxCCCGEF5FgF0IIIbyIBLsQQgjhRSTYhRBCCC8iwS6EEEJ4EQl2IYQQwotIsAshhBBeRIJdCCGE8CIS7EIIIYQXkWAXQgghvIgEuxBCCOFFJNiFEEIILyLBLoQQQngRCXYhhBDCi0iwCyGEEF4kQwX7hqMxfLJ2D4ahPF2KEEIIkS5lqGAH+CnqCGfjkjxdhhBCCJEuZbhgVwrpsQshhBB3kOGCXQghhBB3JsEuhBBCeBEJdiGEEMKLZKhgV3JqXQghhLirDBXsBpLsQgghxN1kqGAXQgghxN1JsAshhBBeRIJdCCGE8CIS7EIIIYQXkWAXQgghvEiGCna53U0IIYS4uwwV7IYkuxBCCHFXGSrYhRBCCHF3EuxCCCGEF8mQwb7+6AVPlyCEEEKkSxku2HWl+HTtHgBOxCYwfOkO9p2/6uGqhBBCiPQhwwX7DXbd4OtNB1i05xSfrd/r6XKEEEKIdMHirg0bhsGIESPYv38/Pj4+jBo1iiJFirieX7BgAd9//z0mk4n27dsTGRl5X9uPnL6eY7HxoOBSQsrDLt8lLtnO8dh4Dl2Mo9VjhTCZNLftSwghhPiv3BbsK1aswGazMXPmTHbs2MG4ceOYMmWK6/kPP/yQRYsWERAQQIsWLWjRogXZsmVL8/aPXY5HoTCUImegrzveAnN3nWDsyt2A8x76sNxZKZs3u1v2JYQQQjwMbgv2qKgowsPDAahUqRLR0dGpni9VqhRxcXFYLBaUUmjag/WEFVAiZ5b/Wu4tbA6dcSt3Y3MYaBqYNA2bbjz0/QghhBAPk9uCPT4+nqCgINdjs9mMw+HAYnHusmTJkrRv3x5/f38aN25M1qxZ77lNhXKNPqdw9qLdNWZNy29W4TAUuuEMcx+LmfgUh3t2JoQQQjwkbgv2oKAgEhISXI8Nw3CF+r59+1izZg0rV64kICCAt99+myVLltCsWbO7bjM5KZmEJAcOiwndcCa6oeDU6VNERSXz5+k4Fh65wisV81Ak64Mfnj9xLYXTF6+QohvkCbByPtGO3aTx/sKNjKlb8IG3mxFERUV5uoRMQdrZ/aSN3U/aOH1yW7BXrlyZ1atX07x5c3bs2EFYWJjruSxZsuDn54evry9ms5ng4GCuXbt2z236+vnhj46/1YzDUCjAMBQFCxSkbIVSvLxuGbph4YJvLtpVCbvn9u7k5U8WY/XzwwpMjKjN+8t3ceRSHLGGmSpVqjzwdtO7qKgor35/6YW0s/tJG7uftLH7paSk3HIaOy3cdrtb48aN8fHxoXPnzowdO5bBgwezcOFCZs6cSYECBYiIiCAyMpIuXboQFxdH27Zt72v7SjlDHSDRrtN4ynJn0CsI8DE/UM17z1+l/Q9rMBQ4dIPP2lQD4JnKxbh+RJ5Fe06lek1MfDLrDp931SKEEEJ4ktt67CaTiZEjR6ZaFhoa6vp3ly5d6NKlywNv31AKhUJDIyY+mSSHjoaGQhHkY72vbSmlOHklke4//4mhFHZdUblgToJ8ndspfv3iPEPBe0t3ktXXSnjxPFxOtNHi65UYCj5vX50aRXI/8PsRQgghHga3Bfuj9PeJi84ePM5e88T1e2lXoXCaXz986U6W7D2NoZTrgrk+4aVvWc/m0DGZNPov2Ao4L+Bz6P87aiCEEEJ4WoYOdt1QWEwahlKuKV11Q5Fgu/fV60l2B42/WEGdorlZfegcdsNAN5zbKZ0nG6Z/3X6nUOgKUNePFijn8LYO3cBqNjNn53EalMjrjrcphBBCpFmGHVL233Oz3xzuafHhqn9ItDlYdegcDsPZUzeUom94GQY3LHfL+tMi6/JuowooBSkOgxTdwK47jxHoymDLyUv33Oe1ZBvzdp8gLtme5jqFEEKI+5Fhg/3fGX7zxXThxUPu+frFe07hMAyU4vr/FZ0qFqVqoZx3HCwnV5Cv6wtEgNXMxHbVGf+086rQpx8riF032HryEsm3OSx/LdlGoynLGbV8Fw2n/MHLsze5njt3LYmBC6PYdureXw6EEEKIu8nQh+JvcA5U47z9LS3j120/dRlDOQ/bOzTnIfipXercc/S74ADfW9ZLticBsCD6JAuiT2IoMGnwV99mWMzO700pDp1GU5Zj151fCnRNseXERVYcOEuJXFnoNHUtDkOx9eQlVr7S5EGbQQghhMi4PfYsflbeb1YJuD4KHZDNzydNrx24KArH9fvXHIYiZ4Bvmoe0/fd6V5PszvPthkJXihSHjm4oev7yl7M2pQifuBSHobDpOrpS2HUDh6EYvHgbnaauxXb9sH6xnEG326UQQgiRZhmyx24oRUKyLdXjAtkCGNakAi/P3nzL+uuPnMesadQulge7bnAlyYbDUFQvnIu/T1xk+FMVH7iW4rmCnLfIXT+sf+Pfe89fZeDCKFYfOoduOAN/bIvKLN5zipyBviyIPolJ05xHDQwDk6ax60wsAxdGcTEhhd1nYwH4oUsdmXhGCCFEmmXIHrtSqc+jKwX17nBePdHm4K3ftvL6vC0YhmLurhPohkIpxWt1SzMtsi7Z/dPW078di8nEG/XKuK6oH9CgHPr13vmqg+cwlCLFYdC//mMUyBZAr1phtK9QBAXXe+4GUzrUROG8KG/lwXPsPBNLskPHrhv0mLHhgWsTQgiR+WTIYIfU59INpbj5CPn6I+f5dedxriTZ6DVrI/r18+8KxWfr9uIwFO3Kp/0+93upXDAnk9vXYFpkXcrly07P6iVQCpIdOskOg9blClEhf45Ur3mjXhkMpfg2ojaBPs4Z7hyGM+iTrx/Od16pD5uOxzB86Q5af7uaTcdjsOsG205dwi6zzQkhhPiXDHko/t8Uigr5/hecuqEYvyqarScusu/CNXRDoZlgw9EY5/3qStGsTIGHWsONUeoAahbJxfd/HwKgUoHg2w6WU7lgTqZF1nU9nhZZl/9bs4edZy7zVOn8tH6sEK/M2YzDMOgz92/X1ft95/4NOEfBqxeah49bV3uo70MIIUTGlrGC/aYpW5Ou31J2YypXH8v/xoc3ADO4zm87b1HTmLxhv2tWOF/Lg40nnxb+Vkuq0E6rfvXLppqbvkrBnGw/fRnd0FE4r7Y3rge8oRTrD1/gWrKNrGm8aFAIIYT3y1CH4hU3pmpVlA7J5lpuKEWuwP9N06qu3+TuHB3OcI0rf+RSHLqh6FSxyKMt/D7cfNV9n/DSrvvm64eGYBiKZLsDu359lDyU6wuOEEIIARmtx36T7P5WUhy3P8esGwplAodSN83brq6PEqdoWDLfI6z0wZk0LVXPv3FYPhRQMFsAb87fSqLdwdlrSYRk8fdckUIIIdKVDNVj/7cL8cmu4AawXR/i9UaA69fvVa9bLA/gHJlOKYWf1X2H4d2pYPZACmUPRNM0LiemYBiKXrM2um6NE0IIITJ0sP/bjdvYlLpxXh1eq1uapx8rBDgHo3n6sYIervLheLxAMLrhHOzmuV/+otGUP1ynIIQQQmReGTLYlQIfs4msvqnnXb/5sXE94MuGZHMFnq4UjcPyP9Ja3eXl2qXQlcKmGyTbda4k2anx6e9M/nM/iWmY3U4IIYR3ypDBbihFqdzZqJA/B/VL5GVci8oAWMwmpnapAzh77y3KFCTI18rFhBSM6+PJ/5fBaNITP6uZaZF1+aBlFQzlHBDHYSi+2XyQ+p8v48zVRE+XKIQQwgMyZLADmE3Oq8efq16C/NkCXMtvvqo84vGiAOQM9PXaw9T5svoz8Mnro905DGwOHbuhmPTnvvvaTrJdZ8+lJBwy6I0QQmRoGfaq+Lu5MZXqDQWyBfBuowoUDQ70UEXu9Vje7HzXuTYHYq4xbmU0umGwfP9Z3nwimdxBfq71LsQloYCtJy9Rr3gIZpNGky9WYNOdt8zFJyQy8Z8lzO1Zn4LZvbOthBDC23llsN/u9q+wPFk9UMmjYzGZKBuSnUFPlmPcqmh0k2LP+au8/fVK1zrq+ry2hlKYNQ0FOHTnfQS6UqToBr66Ytupy+TPGoCmwZaTlyicPZB1R84zcf0+2lUozJ9HL1CzcG5erhOWasQ9IYQQnueVwZ6Zlc2bnadK52fNofO8vWCr8xbA62chdKVAgaY5T2U4rt9FAM4vBoFWEwrFqOW7eH/5LjRujMOvuYa0/SnqKLpSHLsUTzZ/K2sPn+dgzLVUNXzUqir1Qm8/KY8QQgj3ynDBfiOkbpxjF7fadOwiClyTydzQu1YYAT4WPlm7B0NX9KxegidCQzBdvy7hm5V/s/68HYehYzFprnnmNc154eGNHr5CYTZpfLPp4PWZ7AwsJhNcX6/f/K28UKskvWuFeaYBhBAiE8t4wX59WFmTJsF+J5oGdodzfPmpXeqkuqAQuOM49nUKZKF2uXx8vGav67x7l8eL4W81U7NIbhSKSwkp+FktvDV/S6ovDjfWB+eXgW83HaR71dAMOxiQEEJkVBku2MW9fdqmGhfiksmb9f6Hmi0bkp1vImrd8fmC2Z0fmWcqF+f3vaf5pE3VVF+yEmwOXpm9CYehWH7gjGtwICGEEI+GBLsXMmnaA4X6/XiqdH6eKn3rYD+BPhbC8mTj6KU43v9jF+//sQuAIY0r0LqchLwQQrhbhr2PXaRfvhaTa1S8JLtOisNg9PJdxCXbPV2aEEJ4Pemxi4euQ4Ui7DoTi46iZpHcbD5+EbuhaDjlD9c6L9UuxXM1SniwSiGE8E4S7OKhKxoclOoCvXNxSRy/nIBDw3m1PTBlw35SdJ2Xa5fyXKFCCOGFMtyheKvZlGHmUxdOI5tW4tmqxa+PaW9g1w2SHTrfbz7E7J3HiTp5ydMlCiGE18hwPfZvI2p7ugTxABqH5aNxmPMLmV03eH7mX9h1xbiVuwGNeqF5eLdxBWbvPM6F+GSqF85Fo5L5MMl4BUIIcV8yXLCLjM9qNtEoLB8rDpwF3XkV/59HLvDUFyswro9A9Nvuk+Tq5Evlgjk9XK0QQmQsEuzCI7pVDeWZysUxadB9xgaS7DrOEW+dwe5jMTNj2zEJdiGEuE8S7MJjbgwL3K9+WQ7GxNG0dH6CfK30W7CV2EQbqw+d46eoI7QtXxg/i1kOywshRBpkuIvnhPepmD+YDhWLuGaK610zDIfhvMju03V7eWLSMmp+9rtrwhohhBB3Jj12ke6E5cnKu40rMGr5LnSbM8z9rGZemLmRhmH5+HTtHte6M7vV48ileCb+uY/nqpeglYxuJ4TI5CTYRboUljsrX3Wqhd1h8Orczdh0nR2nL7Pj9GV0pa7PKW+i49R1gHNK2feX76JRWD6sZhMJNgfZ/X08/C6EEOLRy1DBPvDJcp4uQTxCfhYzfhYz45+uwtsLo9ANPdXzOjrctEhDo/7ny5yX312fd75cvhyMa/E4Qb5WLCYNH4vMNieE8G4ZKthDsvh5ugThASFZ/O841ewNE9bvZevJS+hKw1Cg4byNbsfpyzT/ehU3Lru7MRHdvOcaUCBbgFvrFkIIT8hQwS7EnfQNL8Pve0+z78JVulYpzrClO0iwOXAYXA91DYXCpGlYTCbafLfaFfYtyhake7VQigYHee4NCCHEQyLBLrxG8zIFaF6mAABTOtR0Lb+YkEKQjwUfi4k3ftvClSQbdl3DpIHJpDE/+iSL/jnFkMblaVO+sKfKF0KIh0KCXXi9XIG+rn9PaFsdpRQJNgevzNmMrjuvureaTYxavpsxK3YDMK5lZZ6UOQmEEBmQBLvIdDRNI8jX6jpvv+7web7ZfBDdUGgamDUTAxZuo0SuLExoW40XZm2kdtHc9A0vQ4CP/MoIIdI3+SslMr16oSHULZ6HSX/uZ+vJi+jomAyNgzHXaPH1KhyGYtaV48zddcL1mh7VSvBKXZlyVgiR/kiwC4HzCvq+4aUBSLI76P3rJpIdeqrnNUzYDQOl4Icth1i89xQT2laneM4gNE2GuxVCpA8S7EL8i7/VwrTIuiil0DQNpRTdZ2wg2aFTJiQb+85fxaYbnL2WRMS0dQxqWI425QrhMBR+VrlPXgjhWRLsQtzBjV64pmmp7qP/dvNB1h4+D4DFZOLDVdF8sCoaFDxRIoR3G1eQUe+EEB4jk8AIcZ+er1GSaZF16V//MXTDIMmuk2TTSXborDl0nsZTlvPt5oNciEvydKlCiExIgl2IB1Qhfw6+7FSLlmUL8kXHGhhKkWR3YDcMJm/YT4uvV9Fv/lZPlymEyGQk2IX4D/wsZjpULOI6L/9izZLYdYNku7MHv+7weS7GJ3u6TCFEJiLBLsRDFF48hGmRdfkuojbG9VnoNp+46OmyhBCZiAS7EG5gMTt/tXSleG/ZTpRSHq5ICJFZSLAL4SY9qoXiMBSGghqf/k71TxZzOTHF02UJIbyc24LdMAyGDRtGREQEXbt25fjx46me37VrF5GRkXTp0oW+ffuSkiJ/8IR3ebJkPpRSpDh07LqBXVc0/XIFey7J1fJCCPdxW7CvWLECm83GzJkz6devH+PGjXM9p5Ri6NChjB07lhkzZhAeHs7p06fdVYoQHjO1Sx0MpbDpBnbdIMVhMG7LWap/spgeMzaw+tA5HLrh6TKFEF7EbQPUREVFER4eDkClSpWIjo52PXf06FGyZ8/O1KlTOXDgAE888QTFixd3VylCeMzNg9tsO3WZT9ftwaYrzA6d3WdieXvBVkyaxmvhpWn1WCECrGZ8LDJ6nRDiwbkt2OPj4wkKCnI9NpvNOBwOLBYLsbGxbN++naFDh1KkSBFeeuklypUrR61ate66zUOHD2M35CIkd9q7b6+nS/Ba/kDPUlmZsvMCCYnOw/EaYNY0xi7dxril27gx5Hx4gSy8WD63x2r1BlFRUZ4uwetJG6dPbgv2oKAgEhISXI8Nw8Bice4ue/bsFClShBIlSgAQHh5OdHT0PYO9RGgomK3uKjnT27tvL2VKl/F0GV6tDJA30NnOhlJ8//ch1/C04OzhmzSIuqwz+fHKmEwyucyDiIqKokqVKp4uw6tJG7tfSkpKqqPdaeW2c+yVK1dm3bp1AOzYsYOwsDDXc4UKFSIhIcF1Qd3WrVspWbKku0oRIl0yaZpreNob/3V5vCi6oVDA3gtXPV2iECIDcluwN27cGB8fHzp37szYsWMZPHgwCxcuZObMmfj4+DB69Gj69etH+/btyZs3L/Xr13dXKUJkGE1LFwDAYRj0nLGBhBS7hysSQmQ0bjsUbzKZGDlyZKploaGhrn/XqlWL2bNnu2v3QmRYQxtX4P3luzBpGtHnrlCjSG5i4pMxlCIki7+nyxNCpHMybasQ6UzJ3Fnxs5oxFLw292804MY1oyYNqhTKyaAny1EkOOiu2xFCZE4S7EKkQ9UL5WLdkfM4NA2Fc+wHTdOwmkxsOhZDx6lrU63foWIRulcLlR69EEKCXYj06IWaJXmuRgk2HL1AxfzBZPWzMmH9XraevASAbihMJg3dUJhNGjO2HePXHcfRNNjQtxlWs4wWLURmJcEuRDpl0jTCi4e4HvcNd96KmGzX2XHmMjaHwY4zsWw96Zw9zm5oWM0m6kxYQkSlotQsmps6xfJ4pHYhhOdIsAuRwfhZzdQs4hy8pl6oM/iVUvx94iKfb9iPMpv4adtRft5+FLOm0bZ8YV6rW5osfjIGhBCZQZqC/fTp0/z4449cvXo11fSTY8eOdVthQoi00zSNGkVykzerP0OX7HAtN5s0ft15nHm7T9CjWgm2n75M8ZxBtC5XiLJ5s3usXiGE+6Qp2N944w2qVq1K1apV0TQZCUuI9KpIjiDX2PQx8cksP3CWZfvPoGkmvtx4AJOmsfXkJebtPkH5fDl4vkYJahXNLb/XQniRNAW7w+Fg4MCB7q5FCPEQ5Q7yI7JyMRyGwfHLCSTYHJy5lgiArjS2nb7Mjrl/YzZpvFS7FM/VKOHhioUQD0Oagr1KlSqsWrWKunXr4uPj4+6ahBAPUbeqoakeX0pI4c35W9ANHXBepDflr/10rVpcrqYXwgukKdiXLl3Kjz/+mGqZpmns3SszgQmR0eQM9HUdrk+yO+j96yaUgjoTlgAwomklGpXMK9PHCpFBpSnY//zzT3fXIYTwAH+r809AskN3TiFr0hj6+3ZGmDQ2v9Fczr0LkQGlKdiTkpKYNGkSGzduRNd1atasyeuvv05AQIC76xNCuNkPXeqQaHNw5FI8H635BzvgbzVT49PfmdKhJuXzZZfeuxAZSJpOqI0cOZKkpCTGjBnDBx98gN1uZ/jw4e6uTQjxCJg0jSBfKxXy52BaZF2alylAisPAphv0/nUTdSYupfonizl8MS7V7a5CiPQpTT32f/75hwULFrgeDxs2jObNm7utKCGE53SqVBQ/i5m5u09g143rY9RrRExbh0mDta895TqEL4RIf9LUY1dKce3aNdfja9euYTbLoTkhvJFJ02hTvjDTIusyLbIuL9UKw6YbJNt1HIbiiUnLsDl0T5cphLiDNH3t7tGjBx06dODJJ59EKcXq1avp1auXu2sTQqQDtYrmplbR3Ez6cx9bTlwEi5nP1u3j7Scf83RpQojbSFOwt2/fnvLly7NlyxYMw2DixImUKlXK3bUJIdKR1+qWZsvJi0zZcIBfdx6je7Xi5JFpYoVId+4a7KtXr6ZBgwb89ttvAAQGBgKwd+9e9u7dS5s2bdxdnxAiHSkWnAVDKRyGouU3qyiUI5Ac/j5MalcDP6ucnhMiPbhrsO/evZsGDRqwefPm2z7/qIPdiGwFF2NSLdOeewXtmeeczw94FaJuU2vFypg+/goANWs66svPbrt9bclfaD4+qCMHUS92uf067/8fWu0nnPvr9BRcunTrSm06YeozwLnOhyNg2aJb1ylYCNPUec6aVi5BjRl6+/39tAAtb37U1Suodo1uv86bg9Fatnfu76Vn4OD+W1cKb4BpxHjn/r6ZhJrxwy2rFDWb4Q9n+6kdW1H9Xrr9/iZ8i/ZYRef+nqoJDset63R7Ea17b+c6Q96ATbcZC6FseUwTv3fub94vqEkf3X5/C9aiBQaiTh5D9ehw+3WGf4BWr6Fzf888DefO3rpSizaY3nrXuc7Ho2Dxb7eukzcfpp8WOmtatxL13u2HUtZ+mI1WqCgqIQHV6onbr/Naf7S2nZ3769MT9uwGoLjdhmG9PoJjzbqYRn/q3N/UL1HTvr51QxYLpmWbnOv8sxPV9/nb7+//vkCrVNW5v5b1ICnx1nW69EB74TXnOiPehvWrb91QyVKYvvjJub9Fc1Cf/G+yp2DgsxQ7KQ6dEb3+jwN2ndzxl1nTrwOBPhay/msGucIffkKOlq0A2NesISnHj92yuxxt2lF4jPOzeXrUCC7+PP2Wday5c1N2rbMNrq5ewbFXe9+2DcLmLca/VGmU3c7OsqG3XSf/24PJ3fMFAA53jyR+y61/M7LUrkvxb6YCcP7LyZz77P9uu62Kew4DkBi9m4Od2tx2neJffU+WuvUAiK5VBf3qlVvWyd39OfIPHALA8f5vcOX3hbes41cyjFLznYMIXZ43h5NDBtx2f2VX/4U1JAT7+fPsaVD7tusUGv0hwW2dfzP2t25G8sEDt6yTvfnTFPnoUwDOfDCamKnfpXresNmIzp2HchujAIj7cx1HevW87f5KzvqNgHLlAe74c8n7ej9Cer8CwJEXuhP3161/M4Kq1SB06s8AxHz/DWfG334isvI79mLy8SFp/z4OtG1x23WKfv4l2Ro4/6bueaIm9piYW9bJFdmVAu+OAODEO28T+9vcW9bxLVKU0ktWAhC7aAEnBrx52/2VWb4WnwIFccTG8k+dqrddp+CIUeTs5MyeAx1akXjhAnzy+W3XvZu7Bnvfvn2B1LO4xcXFce7cOUqWLHnfOxNCZHxZfK1k8bUyunkljutWfli0HqUUCTY7VrMJf+m5C+FRmkrDjam//vorUVFRDBgwgDZt2hAYGEjr1q156aXb9+getpSUFKKjoyFnATDLnNLusnffXsqULuPpMryet7Xz/gtXGb1iNxaTCV+LiU2vN8dk8uyIdVFRUVSpUsWjNXg7aWP3u5F95cqVw9fXN82vS9PtbjNmzOCtt95i0aJFNGzYkIULF/LHH388cLFCCO9RKk82/q9VVRyGgaFg5cHbnAYRQjwyaZ7KKU+ePKxdu5b69etjsVhISUlxZ11CiAwkd5AfAA7DYPDi7VT/ZLHc6y6Eh6Qp2EuUKEHv3r05deoUtWrV4o033qB8+fLurk0IkYFEVi6GXTdItjtwGIpO09ax/dRlT5clRKaTpvvYx4wZw/bt2ylZsiQ+Pj60atWKJ564/ZXAQojMqWnpAjQtXYDVh84xbethjl6Kp/evG/moVVXqhYZ4ujwhMo27BvvMmTOJiIjgiy++AEh129uePXt47bXX3FudECLDqVssD2ZN45vNB9F06Dd/KwCaBv0bPEanSkU9W6AQXu6uh+JlJichxP2ymk3UCw1heJOK2HWDJLuDRLuDZIfO+FX/0G/+VuKS7Z4uUwivddcee+fOzsE1XnrpJdauXUvDhg25fPkyq1aton379o+kQCFExhSaKwvTIuuilOJCfDJvL4wiBZ3Vh86x/sh51r3WVEarE8IN0nTx3NChQ1Pd3rZ582aZj10IkSaaphGSxZ8pHWqSJ8gPm8PAYSjqTVpK52nruBCX5OkShfAqaQr26OhoPvjgAwCCg4MZP34827dvd2thQgjvEuhj4YOWVahdLDcOw8CmG+y/cI2W36ziiUnL+L/V/+DQDU+XKUSGl6ZgNwyDCxcuuB5funQJkynNt8ALIYTL89VL0CgsH+XyZsem6yTadS4npvDztqPUnrCEJXtPe7pEITK0NN3u9tJLL9G2bVvX8IE7d+5kyJAhbi1MCOGdLGYTz1Qu7nqslOK36JP8tvskmgbDl+4gya7TrkJhD1YpRMaVpmB/+umnqV69Ojt27MBisfDuu++SJ08ed9cmhMgENE2jbfnCPP1YQZ775S+SHTrjVu5mfvRJ3m1cnhK5sqBpnh17XoiMJE3H0202G/PmzWPlypVUr16dWbNmYbPZ3F2bECITsZhMTO1SB91QJNgc7D4bS5fp62n5zSr+2H/G0+UJkWGkKdhHjhxJYmIie/bswWKxcOLECd555x131yaEyGQ0TWNaZF0GPlmOFIdOikPn9NVE3rk+/nyizeHpEoVI99IU7P/88w9vvfUWFosFf39/PvjgA/bt2+fu2oQQmdRjebMzLbIuVQrmdI4/79BxGIonPl/GuJW7uZIkRwyFuJM0nWPXNA2bzeY6zxUbGyvnvIQQbtcnvDQAG4/FMOWv/ZhNGrN2HGfOzhNUL5KL4U0qkCeLv4erFCJ9SVOPvVu3bvTs2ZOYmBhGjx5N+/bt6d69u7trE0IIAGoVzc3ULnVoUaYgjus9+L+OxdDym1VMWr9PpogV4iZp6rHXq1ePcuXKsXnzZnRdZ8qUKZQuXdrdtQkhhIumaXSoWIQOFYuwZO9pftl+FGU28d3fh5i65TCaBitebkxWPx9PlyqER6Up2J955hmWLFlCiRIl3F2PEELcU7MyBaiQPweDF29zLfMxm2k4eTlNSuenncwSKzKxNAV76dKl+e2336hQoQJ+fn6u5fnz53dbYUIIcTcFsgUwLbIuACdiE3h3yXbshsapK4kQ4nePVwvhvdIU7Dt37mTXrl2ppnHVNI2VK1e6rTAhhEirwjkCmRZZlxdm/sXe81cwwqTLLjKvuwb7+fPn+fDDDwkMDOTxxx+nf//+ZM2a9VHVJoQQ98WuK8wm6LHsKF8EFyK8uAS8yHzuelX8O++8Q548eejXrx92u52xY8c+qrqEEOK+lcqTlWSHjl1X9Ju/lScn/8GUDfs9XZYQj9Q9e+zffvstAHXq1KFNmzaPoiYhhHgg7zQqz9VkG71mrCPRrpNk1/n+70M8W6U4Wfysni5PiEfirj12q9Wa6t83PxZCiPQom58PI2oVYGqXOhhKYTcUDaf8QUx8sqdLE+KRuK9J1WW0OSFERjKoYTlsDh2bbtDi65WpLgAWwlvd9VD8wYMHadiwoevx+fPnadiwIUopuSpeCJHulQ3JzsR21ekz92/MJo0an/5OweyBvFCzJI3D8nE1yUY2fx+s5vvq4wiRrt012JctW/ao6hBCCLfI5udDgxJ5WX3oHGaTxpFLcQz9fTvDluwAFCZN4/cXG5IrSO59F97hrsFeoECBR1WHEEK4Tc/qJWhfoQjvL9/F+bgk7Dc952M20/zrldQLDSGycjEqF8zpsTqFeBjSNECNEEJkdFn9rIx/ukqqZdtOXeazdXvQlcby/WdZd/g8DUrkZWyLyphMck2RyJjkxJIQItOqXDCYbyJqO2eNMwyS7DorDpzljwNnPF2aEA/MbcFuGAbDhg0jIiKCrl27cvz48duuN3ToUD766CN3lSGEEHdlNZvoULEI0yLrktXPisNQDF2yg+qfLObIpThPlyfEfXNbsK9YsQKbzcbMmTPp168f48aNu2WdX375hQMHDrirBCGEuC+vh5fBYRgk2hzYdIPO09bx1cYDnLma6OnShEgzt51jj4qKIjw8HIBKlSoRHR2d6vnt27ezc+dOIiIiOHLkiLvKEEKINAvNlYVpkXWx6wbPz/wLpeCLvw7w1caD3Djl3rVqcZ6vUZIAH7lESaRPbvtkxsfHExQU5HpsNptxOBxYLBYuXLjApEmTmDRpEkuWLEnzNg8dPozdkAEm3Gnvvr2eLiFTkHZ2v//axv0rBfPboViiLzp76xpg0jQmr93NlLXR3DxeV7WQQLqVzUU2X/N/2mdGExUV5ekSxG24LdiDgoJISEhwPTYMA4vFubulS5cSGxtLr169iImJITk5meLFi9OuXbu7brNEaCiYZVhbd9m7by9lSpfxdBleT9rZ/R5WG1co+79/OwyDEct2ciLW+XdNA9A0NGDXVYOBm2Jo+VhBBj5ZDj+r9wd8VFQUVapUufeK4oGlpKTccrQ7LdwW7JUrV2b16tU0b96cHTt2EBYW5nquW7dudOvWDYC5c+dy5MiRe4a6EEJ4ksVkYlSzx1MtS3Ho/Lb7JIv3nsJs0lgQfZJFe07xcu1SPFejhIcqFZmd2y6ea9y4MT4+PnTu3JmxY8cyePBgFi5cyMyZM921SyGEeKR8LWYiHi/KtxG1yebnQ7JDJ9mu88Vf+0lx6J4uT2RSbuuxm0wmRo4cmWpZaGjoLetJT10IkdFZzSY+bVMNpRTdZ2zAbijCJy7l2861KZ8vh6fLE5mMXNYphBAPiaZpDGtSgff/2I0ya/Sc8ZfravrSIdn4okNNuZpeuJ18woQQ4iEqkSsrA558jA9WRWPXDUyahknT2H3mCk98vowc/j68VLsUJ68kUCYkG01K5fd0ycLLSLALIcRD9lje7EyLrAvA5cQUfow6wtaTl3AYGjF6CqOW70IpMJng3d+3YzGZaFamAAWyBdCuQmGy+/t4+B2IjEzGihdCCDcKDvClb3gZpkXWJbx4CDZdp2np/Nh054V2yXadJLvOnF3Hmbh+H02+WM7P2456umyRgUmPXQghHpHna5Tg+eu3wbWvUASHbrDxeAxfbzroWkdXGh+v2cOSvafpULEI15LtBPiYaf1YISxm6YuJe5NgF0IID7GYTYQXDyG8eAgAdt3gk7V72HvhKtFnr7D7bCwAZk3jg5XRBPlayeJrpU6x3Jy8kohuKIY/VYGQLP6efBsinZFgF0KIdMJqNtGv/mOsPXwOXUGCzcFvu09gVwZmk0aKw+BSQgrHLsejaaCh0fLrVWgaVC6Yk4r5c9CzeolMMfKduDMJdiGESEfMJo0nS+ZzPW5TrhB23WDurhNk87di0jQKZg9gyd4z7DxzGZvuHMN+47EY/j5xke//PsSMrvUIzZXFg+9CeJIEuxBCpHNWs4mIx4umWlY2JDsAhlLEpdhZfeg8c3cdxzCbiJi2jg4VCzOoYflHX6zwOLkSQwghMjCTppHNz4c25QrxaZtq5AzwJcWhM3vnCap/spijl+I8XaJ4xCTYhRDCSwQH+PJBy8pULpiTZLsDm24QMW0d1T9ZzIGYaygl015nBhLsQgjhRTRNo294aaZ0qIldN0i069h1ReT0ddT49Hf+PnHR0yUKN5Nz7EII4YUCfCxMi6zL8dh4ft15nN1nrmA2abw6ZzMa8MYTZaldNDdFg4M8Xap4yCTYhRDCixXJEUT/+o9h1w2en/kXhl1hNml8tPofzJpG16rF6VuvjKfLFA+RHIoXQohMwGo2MS2yLsOaVCDQx0KKQyfFoTN96xHafLdazr97EQl2IYTIRIrnzMKEttWZFlmXIF8ryQ6dU1cSGbV8N4Yh4e4NJNiFECKTmtiuOmVCspHi0Plt9wlqfvY7dScsZcpf+z1dmvgPJNiFECITG/hkObpXCyXZ4Zxl7mqyjW83HaL6J4u5kmTD5tA9XaK4T3LxnBBCZHINSuSlfmgIV5PtTN6wn30XruJjMdNoynIATNfHom9WpgBlQrJRMFuAhysWdyPBLoQQAk3TyO7vwzuNyrPrTCwfrfmHvFn8OR+XhKZpbDruHIvedH3ymcSkRALXnaNk7qwcjLlGr1phdKxYhGz+Pp5+K5meBLsQQohUKuTPwbTIugAopYhNsjFq+W4uJiQDzi8BKQ4Dza6z60wsZpPG5A37+fKvA0RWKcabT5T1ZPmZngS7EEKIO9I0jeAAXz5uXdW1zGEYHDywnzKly3D6aiJDl+wgRdcxaRo/Rx0lPsVBw5J5yZ8tQAbA8QAJdiGEEPfFYvrfddcFsgXwXefaAExcv4+oU5eYt/sE83afwKRpmDTo/HgxXq1bCl+LzBP/KEiwCyGEeCheq1uK36JPEn32CgcvXkMDzCYTP0Yd4ZftRymUI5BnKhfn6ccKYjXLTVnuIsEuhBDiodA0jbblC9O2fGEAdEPxx/4zzNh+FLumcfhiHKOW72Lcyt3ULpaH0c0qEehr9XDV3keCXQghhFuYTRrNyhSgWZkCbDt1mYMXr7F4zykcJo11h89Tf/IfaMD4VlWpVzwPmqZ5umSvIMEuhBDC7SoXDKZywWAiKhVly8mLTFy/Dw2wmE28NX8LJk3DYnJeqDe6+eOUCckm5+QfkAS7EEKIR6paoVxMi6xLkt3B+NX/cOhiHBoamgZJdp3nf/kLk6ZhNZvIHeTH2WuJjGtZGX+rhax+VnIH+pIni7+n30a6JcEuhBDCI/ytFoY1qeh6HBOfzHd/H+JKkg27bmA3FIcvxWExafRfEOVaz6xpFMoRSHyKndxBftQonIuXaofhIz18QIJdCCFEOpE7yI+BT5ZLtex8XBJjV0ZjMZm4EJ/k7Mn7WDhw4RqaBufjktl7/io/Rh1hWmRdSuXJmunP1UuwCyGESLdCsvjzaZtqt30uye7g7xOX+G7zQZTZxDM/rsekOQ/pFw0OIsmu06RUPrL5+9CiTEFyBvo+4uo9Q4JdCCFEhuRvtfBEaAglcmVhwT8n2XgsBgCTprH/wjUAvt18CJOmMXH9Pia1q06NIrk9WfIjIcEuhBAiQyuQLYCXa5fi5dqlALiYkMLRy3HsPB2LAtYfOY/FZKLP3L/JGejHT8/WJTjAe3vvEuxCCCG8Sq5AX3IF+lKtUC4AXqhRgu4zNqDbFfZrSTT9cgWNS+Xn+RolyJfVH3+rd0Whd70bIYQQ4l80TWNaZF2uJtvoM/dvHIbGkr2nWbr3NCZNI9DXgl03KBuSHR+LiTblCtGwZD5Mpox5EZ4EuxBCiEwhm58P0yLr8sf+M5y+msjG4zFk8bNyIS4JP6uFTcdjMJucc8+br99H/0LNkiTZdOqXCKFs3uyefgtpIsEuhBAiU2lSKj8APauXSLU8NjGF1YfO81v0CTRNw+ww+HTtXkwafPf3ITTNeT4/V6AvdYuF0LJsAXIF+XniLdyVBLsQQggB5AjwpV2FwrSrUJjLiSmciE3AYSjmR5/keGw8mqZx5FIcRy/Fs+3UZT7/cx/Nyxbg3cYV0tVsdRLsQgghxL8EB/i6rpyvWignADaHztVkO9tPX+bHqCOYNY2F/5zi972n0YBmZQrQoWIRHgvJ7tHz8xLsQgghRBr4WMzkDjLTpFR+GoXl44/9Z/h521HAee/8guhTLN5zCg2NCvlz8GXHmlg80JOXYBdCCCHuk0nTaFq6AE1LFwDgyKU4foo6SlyKnfNxyWw/fZnaE5bwUu1SdK1a/JEeqpdgF0IIIf6j4jmzMLRJBQB2nYnlozX/4DBpfP7nPqZs2I/VbGJks0qUDclGkK+FrH4+bqtFgl0IIYR4iCrkz8EPXeowe+dxFu05BYDVMDFwYZRrghpNg6GNK9CqXKGHvn8JdiGEEOIhM2kanSoVpVOlolxJsvHN5oPk8PflcmIKu8/GYjZpvP/HLkYt30Wf8DI8U7nYQ7vgToJdCCGEcKPs/j70r/+Y67FSihdnbSLJoWPWND5bt5fv/z7EH70bPZSL7dLPjXdCCCFEJqBpGt9E1OLrjjWpVCCYZLuDK0k2ak9Ywl9HL/zn7UuwCyGEEB7gYzHTN7w0gxuVx+bQSXEYvD5vC9U/WczBmGsPvF0JdiGEEMKDSufJxjcRtQnytZBkd2DTDSKnr6f1t6sfaHsS7EIIIYSHWc0mJrStzpcda5HVz0qi3YGu1ANtSy6eE0IIIdIJP6uZT1pX41JCCicvXwUS73sb0mMXQggh0pmcgb40CM37QK+VYBdCCCG8iNsOxRuGwYgRI9i/fz8+Pj6MGjWKIkWKuJ5ftGgRU6dOxWw2ExYWxogRIzCZ5HuGEEII8V+4LUlXrFiBzWZj5syZ9OvXj3HjxrmeS05O5tNPP2XatGn88ssvxMfHs3r1g139J4QQQoj/cVuwR0VFER4eDkClSpWIjo52Pefj48Mvv/yCv78/AA6HA19fX3eVIoQQQmQabjsUHx8fT1BQkOux2WzG4XBgsVgwmUzkypULgOnTp5OYmEidOnXuuc1Dhw9jNx7s8n+RNnv37fV0CZmCtLP7SRu7n7Sxe+X0M5Mn4P5ngXNbsAcFBZGQkOB6bBgGFosl1ePx48dz9OhRJk6c6Jrx5m5KhIaC2eqWeoXzl7RM6TKeLsPrSTu7n7Sx+0kbu18OHxOxp47c9+vcdii+cuXKrFu3DoAdO3YQFhaW6vlhw4aRkpLC5MmTXYfkhRBCCPHfuK3H3rhxYzZs2EDnzp1RSjFmzBgWLlxIYmIi5cqVY/bs2VStWpXu3bsD0K1bNxo3buyucoQQQohMwW3BbjKZGDlyZKploaGhrn/v27fPXbsWQgghMi25cVwIIYTwIhLsQgghhBeRYBdCCCG8iAS7EEII4UUk2IUQQggvIsEuhBBCeBEJdiGEEMKLSLALIYQQXkSCXQghhPAiEuxCCCGEF5FgF0IIIbyIBLsQQgjhRSTYhRBCCC8iwS6EEEJ4EQl2IYQQwotIsAshhBBeRIJdCCGE8CIS7EIIIYQXsXi6gP/M0EEpT1fhFSwmDXSHp8tITdPAZPZ0FUIIkWFk6GD3M2zkzhqIjzVDv410o2CWMvj6+nm6jFRsdgcx1xJINvl4uhQhhMgQMm4iGjq5swYSGBjg6Uq8hm7oWH3SV4DeqOfktWTpuQshRBpk3HPsSklPPZPwsVrkdIsQQqRRxg12IYQQQtxCurz/wYLf5nHs6FH6vvlWquWD3u7P+2PGYLW657D2mdOniWjfltJlyqJpkJJio2r16vR5/Q2+mPw5S39fTO7ceQC4euUKTZo144Vevd1SixBCiPRFgt0Nxo3/yO37KBYaytff/wCAYRj07PosB/bvB+DZbt3p0CkCAJvNRofWrWjXvgPBOXO6vS4hhBCe5TXBPnnDftYcOvdQt1m/RF5eqVPqruvs2rmT3i88R0J8PL1feZXwek/Q4qnGzF2wiDEj38Pq48OZM6e5GHOR90aNpkzZsvzy80+sWrkCh8NBUFAW/u/TT1myeDHz581DKYMXer/Eb3Pm8OHHnwDQs+szfPjxp+TOnfu2NaQkJ2O32/Dzv/WK9qtXruBw2PH1S/3c7l27GP/BWFCK3HlCGD3uA17t3Yt3h79HseLFmT1rJhcvXqRV6za88dqrZMuenTrh4Sz47TfmzF+ApmmMHfU+NWrVolChwowfNwalIFv2bAwfOYosWbI8YKsLIYT4L7wm2D3F39+fCZOnEHv5Mt2e6UKduuGpns+XPz/vDh/B3Nm/Mnf2rwx+dyhXr17li6+/xWQy8UrvF/knOhqArFmz8snESSil+GjcOK5dvcrFizFkz57jllA/evgwL/bs4bzN22SmyzPPUrhwEQB+nDaVpb//zvlz58gdkoeh740kMDAw1etHvTecseM/onjxUGb9MoOjR47c8T1evHSRn2bNwmr1Ye+ePWyLiqJ8hQpEbd3C24MG81z3rowY+T7FQ0vw29w5TP3+O17r+/rDaF4hhBD3yWuC/ZU6pe7Zu3aHSpUro2kawTlzEhQUxNUrV1I9X7p0GQBC8uZl5/btmEwmrFYrgwe8TUBAABfOn8fhcA4KU6RYUQA0TaN5y5YsXfI7p0+dok27drfs9+ZD8f9241D8nn/+YfCA/hQpUvSWdS5fukTx4qEAdOrc5Zbn1U1XoRcoUMB1vUC79h1YtGA+ly5e5In6DbBYLBw7coSxo0YB4HDYKXyb/QkhhHg05Kr4/2jP9d72xYsxJCYmkj1HjtQraKkfHti/nzWrVvLBR//HgMHvYBjKFaIm7X8/jlZt2rLij2Vsi9pKnfB6D1Rb2cceo+fzLzBoQH8Mw0j1XO48eThx/DgAP3z7DatWrsDHx5eLF2MA2Ld3z//egul/dVWvWZP9+/Yy/7e5tL7+haNI0aKMHDOGr7//gdff6kd4vQerVwghxH/nNT12T0lOSabX8z1JSkxkyLARaJp21/ULFS6Mn78/z0R0wsfHSq7cuYi5EHPLenlCQggIDKR8hYpYLA/+Y2rTrj1/LF3KrzN/IaJLpGv5kGHDGTHsXUyaiVy5cxPZtRugGDd6FCF585InT8htt6dpGg0bN2Hzpo2uQ/+D3x3GsHfeQTd0AIa/9/4D1yuEEOK/0ZRK/yN/pKSkEB0dDTkLgNnqXKg7CM2VJd2NlPYw9X31FfoPHOgKUHdLTk7Cz8//kezrfthtNg5fjAOzd3wP3btvL2Wun6IR7iFt7H7Sxu6Xw8dE7KkjlCtXDl9f3zS/Tg7Fp0PJyclEdupIWKlSjyzUhRBCeAfv6AJ5GT8/P36e9aunyxBCCJEBSY9dCCGE8CIS7EIIIYQXkWAXQgghvIgEuxBCCOFFJNgfkh++/YYmDZ4gJSXlgbex4Ld5NG/ckBd79qDXcz3o/kwkfyxd+p/q6vfGnYd2/f6br4neves/bf9mX06ZTNcuEfR49pnbbnfliuW0ataUF3v24MWePYjasgWAT/7vI7o/E8mznTsxd7ZcNCiEEP+FXBX/kPy+eDFNmjZj2ZLfadWm7QNvp2nzFq5pYK9evUJEu3Y0fuqpew58cyf/9+lnd3yu5wsvPtA2b2fvnj1Ebd3CtJ9/4dy5s7z95hv8+MusVOvs27OH1996i4aNm7iWbfl7M6dOnGDqTz87Z6Jr04pGjZuQNVu2h1abEEJkJl4V7Acrht12ec4+bxH8wksAnH6pJ4kbN9yyjn/VGhT8djoAsVO/5eLHH1By54E07Xfrlr8pVKgQHTpF8O7ggZQuU5aPPhzHV99+DzgHmnnltT5cuHCeLz6fRFBQEFmyZqNkWBgvvfLqHbcbdy0OXz9fNE2jY9vWFC5SFB8fK+8MHc7I4UNd49K/PegdSoaF8dvcOfw6cyaGofNEgyd56ZVXaVy/HsvXrGPWLzNYtGA+mmaiUuXKvNmvP8OHvEOTZs2oXqMm7w0ben2IWcUz3brzVNNmvNizB2GlS3H44CESEuL54P8+weGw8/7w4anqbNq8OTabjVq1aqNpGvny5UfXdWIvXyZHcLBrvb179rB/3z5++nE65cqVp++bb1GhYiVKlSoNgKY5p6C1WL3qYymEEI+U/AV9CObNmUOb9u0pWqwYPj4+pKSkkJKcwpkzZ7BarVy5EkvJsDDefvMNfvjxJ3LmysWQgQNuu62lvy9m965daCYNPz9/3h8zDoDExERe7P0SpcuU4bOP/4/qNWrSMaIzJ44fZ8TQIXz0yWd8/+03zJwzDx8fHz4e/yGJiQmu7S74bR4DBg+hQsWK/DrzF9fEMwBzfp1F9uzZeXf4cHTdILJTB6rXqAlAuXLleXvgYCZN+Ixlvy+m5wsv3nbymW++/IJs2bO7HgcEBBIXH5cq2GvWqkX9JxtSoGBBRo98j9mzZtI58hl8fX2x2+0MG/IO7Tp0JCAg8JbtCyGESBuvCva09LALfPH9PdfJ0f15cnR/Pk37vHb1KhvWryP28mV++fkn4uPimTnjZ9q0a8fiBfOx+vjQqnVbYmMvExgUSM5cuQB4vEoVLl68eMv2bj4U/29FihYF4NDBg2z5e7Pr/Pu1a9c4deoUJUqUxO/6vOv9Bw5K9doR749m+g/fM+GTj6lQsWKq2duOHjlCjVq1AAgMDKR48VBOnTwJQKkyziEj8+bNy8WLFzlx4vhte+yBQUEkJPzvi0RiYgJZsmRNtV7rtu3IktW5rH6DJ1m5YrmrDd/u9yZVq1bjuYd4ekAIITIjrwp2T/h90SJat2vPm/36A5CUlMTTTZ/itddfZ8Bbb4KmMfnLrwkICCAxIdF1eHr3zp3kK1DgvvZluj7LWtFixWjesiXNWrTk8qVLzJs7h0KFCnH06FFsNhs+Pj68/dYbvD1wsOu18+bM5p1hw/H19eWV3i+ya8cO13PFihdne1QUtevUISEhgUMHD1Lgem3av6anK1y4yG177Hv++YfPPvk/uvXoyfnz5zAMgxw3zXSnlCKifVu+n/4TIXnz8vfmTZQpW5bk5GReevF5nu3Wg+YtW95XewghhLiVBPt/NG/ubNfhcgB/f38aNm7E4oULKRlWCl3XCQoKAmDgO0Po88pLBAVlwVAGhYo82Djwz/fqzchhQ5k7ezYJCfH0fvkVcgQH0+O553ihZ3c0NOrVr0+ekP/N0FaiZEm6do4ge3AO8uQJoVyFCiz4bR4A7Tt25P0Rw3npheex2ez0evllgnPmvK+ayj72GI9XrkKPZyMxDINBQ94F4O/Nm9ixbRu9Xn6Foe+NpP+br+Pr60fx0FDatu/AzBk/c+rUKebNmc28ObMBGPH+KAoULPhAbSOEEJmdzO72CH33zdc82607Pj4+DBk0kFq1a9OyVWtPl+Uis7s9GjIrlvtJG7uftLH7Pejsbt7xlzKDCAgIoPszXfDz8yN//gI0adrM0yUJIYTwMhLsj1DnyGfoHPmMp8sQQgjhxWTkOSGEEMKLZNxg1zRsdse91xMZns3ucI5eI4QQ4p4y7qF4k5mYa877pn1kpLKHwmG3YzeZPV1GKja7w/lzNmWciySFEMKTMnQiJpt8OHktGdL/hf0ZwsHDhygZWsLTZaSmaRLqQghxHzJ0sAOQznqYGZnDUF5zS5kQQmRWbjvHbhgGw4YNIyIigq5du3L8+PFUz69atYr27dsTERHBrFmz7rAVIYQQQtwPtwX7ihUrsNlszJw5k379+jFu3P9GZ7Pb7YwdO5bvvvuO6dOnM3PmTGJiYtxVihBCCJFpuO24a1RUFOHh4QBUqlTJOXLcdYcPH6Zw4cJkuz7ndpUqVdi6dSvNmt1+wJYbg+P5aGAyyfl0dwmymPCT9nU7aWf3kzZ2P2lj9zMp551f9ztArNuCPT4+3jVGOoDZbMbhcGCxWIiPjydLliyu5wIDA4mPj7/jtux2OwC2i6fdVa4ACmX1Jfnc8XuvKP4TaWf3kzZ2P2lj90u+/n+73e6auTMt3BbsQf+axtMwDCwWy22fS0hISBX0/xYYGEhYWBhWqxVN7mcWQgiRCSilsNvtBAYG3tfr3BbslStXZvXq1TRv3pwdO3YQFhbmei40NJTjx49z5coVAgIC2Lp1K88/f+f5z00m012DXwghhPBG99NTv8Fts7sZhsGIESM4cOAASinGjBnDnj17SExMJCIiglWrVvH555+jlKJ9+/Y884yMoS6EEEL8Vxli2lYhhBBCpE3GHSteCCGEELeQYBdCCCG8SLoLdhmxzv3u1caLFi2iY8eOdO7cmWHDhmEYhocqzbju1cY3DB06lI8++ugRV+cd7tXGu3btIjIyki5dutC3b19SUlI8VGnGdq92XrBgAW3btqV9+/b8/PPPHqrSO+zcuZOuXbvesvy+c0+lM8uWLVMDBw5USim1fft29dJLL7mes9lsqlGjRurKlSsqJSVFtWvXTl24cMFTpWZYd2vjpKQk1bBhQ5WYmKiUUurNN99UK1as8EidGdnd2viGGTNmqE6dOqnx48c/6vK8wt3a2DAM1apVK3Xs2DGllFKzZs1Shw8f9kidGd29Pst16tRRsbGxKiUlxfX3Wdy/r776SrVs2VJ17Ngx1fIHyb1012NP64h1Pj4+rhHrxP25Wxv7+Pjwyy+/4O/vD4DD4cDX19cjdWZkd2tjgO3bt7Nz504iIiI8UZ5XuFsbHz16lOzZszN16lSeffZZrly5QvHixT1VaoZ2r89yqVKliIuLw2azoZSSsUYeUOHChZk4ceItyx8k99JdsN9pxLobz93PiHXi9u7WxiaTiVy5cgEwffp0EhMTqVOnjkfqzMju1sYXLlxg0qRJDBs2zFPleYW7tXFsbCzbt28nMjKS77//nk2bNrFx40ZPlZqh3a2dAUqWLEn79u1p0aIF9evXJ2vWrJ4oM8N76qmnXIO43exBci/dBfvDHLFO3N7d2vjG4w8++IANGzYwceJE+Qb+AO7WxkuXLiU2NpZevXrx1VdfsWjRIubOneupUjOsu7Vx9uzZKVKkCCVKlMBqtRIeHn5LT1Okzd3aed++faxZs4aVK1eyatUqLl++zJIlSzxVqld6kNxLd8FeuXJl1q1bB3DXEetsNhtbt27l8ccf91SpGdbd2hhg2LBhpKSkMHnyZNcheXF/7tbG3bp1Y+7cuUyfPp1evXrRsmVL2rVr56lSM6y7tXGhQoVISEhwXei1detWSpYs6ZE6M7q7tXOWLFnw8/PD19cXs9lMcHAw165d81SpXulBcs9tQ8o+qMaNG7NhwwY6d+7sGrFu4cKFrhHrBg0axPPPP+8asS4kJMTTJWc4d2vjcuXKMXv2bKpWrUr37t0BZxA1btzYw1VnLPf6HIv/7l5tPHr0aPr164dSiscff5z69et7uuQM6V7tHBERQWRkJFarlcKFC9O2bVtPl+wV/kvuychzQgghhBdJd4fihRBCCPHgJNiFEEIILyLBLoQQQngRCXYhhBDCi0iwCyGEEF4k3d3uJoRwj1OnTtG0aVNCQ0MB50AjCQkJtGnThr59+z6UfdwYErNPnz6UKlWK/fv3P5TtCiHSToJdiEwkT548zJ8/3/X4/PnzPPXUU7Ro0cIV+EKIjE0OxQuRicXExKCUIjAwkK+++oq2bdvSqlUrPvzwQ24McfHDDz/w1FNP0bx5c8aPHw/AgQMH6Nq1K+3bt6dBgwbMmDHDk29DCHET6bELkYlcuHCB1q1bk5KSQmxsLOXLl2fSpEkcOHCA6OhoZs+ejaZpvP322yxYsIBixYrx888/M2fOHPz9/XnhhReIjo5m/vz5vPLKK9SqVYuTJ0/SqlUrunTp4um3J4RAgl2ITOXGoXjDMBg3bhyHDx+mTp06jB8/nl27drnGrE9OTiZ//vxcvHiRBg0auCad+OGHHwAoU6YM69ev58svv+TAgQMkJiZ66i0JIf5Fgl2ITMhkMjFgwADatGnDt99+i67rdO/enZ49ewJw7do1zGazqwd/w/nz5/H392fIkCFkzZqVBg0a0Lx5cxYtWuSptyKE+Bc5xy5EJmWxWBgwYACTJ0+mbNmyzJ8/n4SEBBwOB6+++irLli2jatWqrF271rW8X79+REdHs2HDBvr27UujRo1cM3/puu7hdySEAOmxC5Gp1atXj8cff5ytW7fSpEkTOnXqhK7rhIeH07ZtWzRN49lnn6Vz584YhkHjxo2pXbs2ffr0ITIyEl9fX0qXLk2BAgU4deqUp9+OEAKZ3U0IIYTwKnIoXgghhPAiEuxCCCGEF5FgF0IIIbyIBLsQQgjhRSTYhRBCCC8iwS6EEEJ4EQl2IYQQwotIsAshhBBe5P8B602cmytsaUYAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 576x396 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plot_model(tuned_rf, plot = 'pr')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "_r9rwEw7EQrz"
   },
   "source": [
    "### 10.3 Feature Importance Plot"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "nVScSxJ-EQr2",
    "outputId": "f44f4b08-b749-4d0e-dcc9-d7e3dc6240c8"
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAAFKCAYAAABB4xbCAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy86wFpkAAAACXBIWXMAAAsTAAALEwEAmpwYAABC7klEQVR4nO3dfVhUdf7/8eeA3Bj2E0vDm3IXLTRlNbJ1YDUtx9uSMk0gabbW7i1bcb3LLypLUqiV26arhezaIusNponybcmbWrVyatEMMDcjK03CWsWClBE4vz+6nK/EjaQHGJjX47q6Ls5nzvmc93umcV5zzpkZi2EYBiIiIiIm8GrqAkRERKTlULAQERER0yhYiIiIiGkULERERMQ0ChYiIiJiGgULERERMU2rpi5ARC5Njx49CAkJwcvr/94nhIaGkpSUdFHzffTRR6xfv57ExESzSqymR48evPfee1xxxRUNto+aZGRk4HQ6iY2NbdT9nu/8x8tisVBeXk5kZCSPPPIIDoeDp59+mi1bttQ5x5IlS+jZsydDhw5tpKpF6k/BQqQFePXVV017kf70008pKioyZS53k5OTw3XXXdfUZVR5vEpKSrjzzjsJCQnhsssuq9f2DoeDa6+9tiFLFLloChYiLVhBQQFJSUkUFxdTUVGB3W7n7rvvprKykmeeeYb9+/dTWlqKYRjMnz+fzp078+c//5nvv/+ep556ijFjxlR5B33+O+qXXnqJDz/8kOPHj9OjRw+ee+45li1bxptvvkllZSVdunRh3rx5BAUF1Vrf0aNHue+++xgwYAB5eXlUVFTw5JNPsnbtWj777DNCQ0N54YUXOHbsGHa7nZtvvpn9+/djGAZz587lpptu4uzZsyQnJ/Pee+/h7e1Nnz59eOqpp2jTpg1DhgyhT58+/Oc//2Hq1Kns2LGDd955B39/f0aMGMHcuXP573//yzfffEOXLl3405/+xJVXXsmQIUO46667eO+99ygsLOTOO+9kypQpAKxfv56//e1veHl50a5dOxYsWECnTp3YsWMHy5Yt4+zZs/j7+zNz5kzCwsIu+Bi1adOG0NBQV7/nfP/99/zxj3/k4MGDWCwWbr75ZqZOncratWvJy8tj4cKFeHt7M2zYsEv7n0TEbIaINGshISHG6NGjjTvuuMP137fffmucPXvWuO2224y8vDzDMAzju+++M0aNGmXs27fP2Lt3rzF58mSjoqLCMAzDePnll41HHnnEMAzDeO2114yHH37YMAzD2LNnj3H77be79nX+8p///GdjxIgRxtmzZw3DMIyNGzcaU6ZMcS2vWbPGePDBB2ut+b///a9x5MgRIyQkxNi2bZthGIYxd+5c49ZbbzW+//5748yZM8aAAQOMnJwc13qZmZmGYRjG22+/bQwYMMBwOp3Giy++aDzxxBOG0+k0KioqjFmzZhlz5swxDMMwbr31VmPJkiWu/c6cOdNYsWKFYRiGsXLlSuPll182DMMwKisrjQcffNBITU11bZecnGwYhmF8/fXXxq9+9Svjyy+/ND7++GPDarUax44dMwzDMP72t78Zc+bMMQ4fPmyMHj3aOHHihGEYhvHJJ58YAwYMMEpLS2vt/ZyCggIjIiLC2L9/f5X7d8aMGcbTTz9tVFZWGmVlZcbEiRNd9d57773GG2+8UeN9K9LUdMRCpAWo6VTIp59+ypdffsns2bNdY2fOnOHAgQNMmDCBtm3bsmbNGo4cOYLD4SAgIOBn7/eGG26gVasf/xl56623yM3NZdy4cQBUVlZy+vTpC87h4+PDkCFDAOjatSthYWG0adMGgKuuuopTp05x1VVX0bZtWyIjIwEYPHgw3t7e/Oc//2Hnzp3ExcXh4+MDgN1u5/HHH3fNf9NNN9W43/vuu49///vf/O1vf+Pzzz/n0KFD9O3b13W7zWYDICgoiCuvvJJTp07xwQcfMHDgQDp16gTA/fffD0B6ejrHjx93LQNYLBa+/PJLevbsWeO+vby8qKyspHXr1syYMYM+ffrgcDhc6+zcuZPVq1djsVjw9fUlJiaGV199lYcffviC96lIU1KwEGmhKioquPzyy9m0aZNr7Ntvv+Xyyy/n7bffJikpid/97nfYbDa6detGZmZmtTksFgvGeT8ndPbs2Sq3n39NQGVlJQ8++CATJkwAwOl0curUqQvW6ePjg8ViqbJcE29v7yrLlZWVeHt7U1lZWWX7ysrKKnXWdt3CokWL+Oijjxg3bhxWq5Xy8vIqvfr5+bn+Pnc/eHt7V9nXmTNn+Oqrr6isrCQiIoI//elPrtsKCwu56qqratx3fa6Jqamv8vLyOrcRcQf6uKlICxUcHIy/v78rWBQWFjJ69Gjy8vJ45513uPXWW5kwYQKhoaFs27aNiooK4McX8HMvYFdccQXHjh3jv//9L4ZhkJWVVev+Bg4cyPr16ykpKQHgxRdfZMaMGab1c+LECXbu3AnAjh078PHxISQkhJtvvpnVq1dz9uxZKisrSU9PZ8CAATXOcX5vu3fv5r777mPMmDFceeWVvPvuu677oDZWq5X33nuP48ePA7BmzRoWLVpEREQE77zzDgUFBQD861//4o477uDMmTMX3e/AgQNZtWoVhmHgdDpZt24dv/nNb6r1IeJudMRCpIXy9fXlL3/5C0lJSaxYsYLy8nJ+//vf069fPwIDA/nDH/5AZGQk5eXlDBgwwHXR5Q033MDSpUt54oknWLJkCTExMYwbN44OHTpwyy23kJubW+P+xo8fT1FREVFRUVgsFjp16kRycrJp/fj5+bFp0yaee+45/P39Wbp0Kd7e3jz22GMsWLCAMWPGUF5eTp8+fZgzZ06NcwwaNMhV0+OPP87ChQt58cUX8fHx4cYbb+TLL7+ss4YePXowffp0HnzwQQA6dOjAM888Q1BQEImJiUydOhXDMGjVqhXLli27qNNL58THxzN//nwiIyM5e/YsN998M48++igAQ4YM4YUXXuDs2bPcddddF70PkYZgMQz9bLqIuLejR48SGRnJvn37mroUEbkAnQoRERER0+iIhYiIiJhGRyxERETENAoWIiIiYhp9KuQSVVZWUlpaWu2z+CIiIi2RYRicPXuWgICAKj9+eI6CxSUqLS3lk08+aeoyREREGlVISAiXX355tXEFi0t07lsCQ0JC8PX1NWXOvLy8Kj9G1JJ5Sq+e0id4Tq+e0id4Tq+e0idcWq9Op5NPPvmk1m/JVbC4ROdOf/j6+lb5CuBLZeZc7s5TevWUPsFzevWUPsFzevWUPuHSe63t9L8u3hQRERHTKFiIiIiIaRQsRERExDQKFiIiImIaBQsRERExjYKFiIiImEYfNxUREWmh1uw7TPL2PA4UnaJXUFtm2UKJCQtu0H26zRELh8NBREQEdrsdu91OVFQUaWlpAMybN48xY8YAUFJSwrBhw8jJyXFte+DAAUaNGkVpaWmd+9i/fz92u/2CtaxcuZLx48czfvx4lixZcvFNiYiINJE1+w4Tu2o3uYXFVFQa5BYWE7tqN2v2HW7Q/brVEYvw8HAWL14M/PjNXiNHjmT48OHs3buXkJAQHA4HVquVpKQk4uPj2bhxI15eXsTHx5OcnExAQECtc6ekpJCZmUnr1q3rrOHIkSNkZmaSkZGBxWJhwoQJDB06lJ49e5raa112WbrgyD/RaPtrSk4P6dVT+gTP6dVT+gTP6bWl9fls1v4axxdsz2fFrZ0abL9uFSzOV1JSgpeXF1u3biUiIoJBgwaRnp6O1Wqlf//+DB48mKVLl+Lv74/NZqNv3751zte1a1deeuklZsyYUed6HTt2ZMWKFXh7ewNQXl5er28ny8vLq39zF2LpgrPMad58bs5TevWUPsFzevWUPsFzem1JfX5dXFLjeP7XJ4FOVY78m8mtgsWePXuw2+1YLBZ8fHyYM2cOy5cvJzExke7du5OQkEBRURFBQUHExcURHR1NYGAgqampF5x7xIgRHD169ILr+fj4cMUVV2AYBgsXLqRXr14EB1/4fFRoaKh5XwWbk0O/fv3MmcvN5XhIr57SJ3hOr57SJ3hOry2tz5U72pJbWFxtvHfHdgAX3WtZWVmdb6bdKlicfyoEoKCggEOHDpGcnAz8+L3kq1evZsqUKfj5+WGz2Wjfvr3r6IJZysrKmD17NgEBAcybN8/UuUVERBrDLFsosat2VxufaesNlQ13ysetgsVPZWRkEBcXR2xsLADHjh0jOjqaSZMmmfZLoj9lGAaTJk3CarXy8MMPN8g+REREGtq5T38s2J7PgaJiegUFMtPWm5iwYHJyPDBYOJ1OsrKy2LRpk2usc+fO9OzZk+zsbCIjIxtkv9u2beP999/H6XSya9cuAKZOnUpYWFiD7E9ERKShxIQFN/jHS3/KbYKF1WrFarW6ln19fV0v7OdLSUlx/T158uSftY+rr76adevW1bnOsGHDyM3N/VnzioiIyI/cJliYISEhgYKCgmrjKSkp+Pv7Vxlbu3YtW7Zsqbaujk6IiIhcvBYXLOorOjqa6OjohitGRETEA7nNN2+KiIhI86dgISIiIqZRsBARERHTKFiIiIiIaRQsRERExDQKFiIiImIaBQsRERExjYKFiIiImEbBQkREREyjYCEiIiKmUbAQERER0yhYiIiIiGkULERERMQ0ChYiIiJiGgULERERMY2ChYiIiJhGwUJERERM4zbBwuFwEBERgd1ux263ExUVRVpaGgDz5s1jzJgxAJSUlDBs2DBycnJc2x44cIBRo0ZRWlpa49xnz55l+vTpTJgwgbvvvpvt27fXWcvKlSsZP34848ePZ8mSJeY0KNLMrdl3mBue24zv9FXc8Nxm1uw73NQliYgbatXUBZwvPDycxYsXA+B0Ohk5ciTDhw9n7969hISE4HA4sFqtJCUlER8fz8aNG/Hy8iI+Pp7k5GQCAgJqnDczM5PAwEAWLVrEyZMnueuuu7DZbDWue+TIETIzM8nIyMBisTBhwgSGDh1Kz549G6xvEXe3Zt9hYlftdi3nFha7lmPCgpuqLBFxQ24VLM5XUlKCl5cXW7duJSIigkGDBpGeno7VaqV///4MHjyYpUuX4u/vj81mo2/fvrXONXLkSEaMGOFa9vb2rnXdjh07smLFCtc65eXl+Pn5mddYPeyydMGRf6JR99lUnB7Sa3Pv89ms/TWOL9ier2AhIlVYDMMwmroI+PFUyJQpU7j22muxWCz4+Pjw29/+luXLl5OYmEj37t0ZPnw46enpBAUFUVZWRnR0NIGBgaSmptYZFs4pKSnhscceIyoqisjIyDrXNQyDhQsXUlpaSmJiYq3rlZWVkZeX97P7rcsuSxdT5xO5VNP/sY3KGv6p8LbAe/f0aoKKRKSphYaG1vjG262OWJx/KgSgoKCAQ4cOkZycDIDFYmH16tVMmTIFPz8/bDYb7du3r1eoKCws5PHHH2fChAkXDBVlZWXMnj2bgIAA5s2bV6/aa7uDL0pODv369TNnLjeX4yG9Nvc+V+5oS25hcbXx3h3bVeurufdaX57SJ3hOr57SJ1xarxd6Q+1WweKnMjIyiIuLIzY2FoBjx44RHR3NpEmT8PX1rfc83377LRMnTmTu3LlERETUua5hGEyaNAmr1crDDz98SfWLtBSzbKFVrrE4Z6atdxNUIyLuzG0+FfJTTqeTrKwsRo0a5Rrr3LkzPXv2JDs7+2fNtXz5cr777jv+8pe/uD51cubMmRrX3bZtG++//z67du1yrbtv375L6kWkuYsJCyb93oH06dSOVl4W+nRqR/q9A3V9hYhU4zZHLKxWK1ar1bXs6+vLrl27qq2XkpLi+nvy5Mn1mjs+Pp74+Ph6rTts2DByc3Prta6IJ4kJC1aQEJELcptgYYaEhAQKCgqqjaekpODv719lbO3atWzZsqXaulOnTiUsLKzBahQREWnJWlywqK/o6Giio6MbrhgREREP5LbXWIiIiEjzo2AhIiIiplGwEBEREdMoWIiIiIhpFCxERETENAoWIiIiYhoFCxERETGNgoWIiIiYRsFCRERETKNgISIiIqZRsBARERHTKFiIiIiIaRQsRERExDQKFiIiImIaBQsRERExjYKFiIiImEbBQkREREzTqqkLEGmJ1uw7TPL2PA4UnaJXUFuigwPo16+pqxIRaXhuc8TC4XAQERGB3W7HbrcTFRVFWloaAPPmzWPMmDEAlJSUMGzYMHJyclzbHjhwgFGjRlFaWlrj3BUVFTz11FPExMQQGxvLl19+WWctK1euZPz48YwfP54lS5aY06B4jDX7DhO7aje5hcVUVBrkFhYT/+5XrNl3uKlLExFpcG51xCI8PJzFixcD4HQ6GTlyJMOHD2fv3r2EhITgcDiwWq0kJSURHx/Pxo0b8fLyIj4+nuTkZAICAmqc96233gJgzZo1OBwOnn32WZYtW1bjukeOHCEzM5OMjAwsFgsTJkxg6NCh9OzZs2GarsEuSxcc+ScabX9NydkCe302a3+N4wu25xMTFtzI1YiINC63ChbnKykpwcvLi61btxIREcGgQYNIT0/HarXSv39/Bg8ezNKlS/H398dms9G3b99a5xo6dCi33HILAMeOHaN9+/a1rtuxY0dWrFiBt7c3AOXl5fj5+V2w3ry8vJ/XYF0sXXCWOc2bz821tF6/Li6pcTz/65NVjrS1ZOqz5fGUXj2lT2i4Xt0qWOzZswe73Y7FYsHHx4c5c+awfPlyEhMT6d69OwkJCRQVFREUFERcXBzR0dEEBgaSmpp6wblbtWrFzJkz2bp1K3/+859rXc/Hx4crrrgCwzBYuHAhvXr1Ijj4wu8yQ0ND6xVA6iUnh34eckI+pwX2unJHW3ILi6uN9+7YrsX1WpOW+JjWxFP6BM/p1VP6hEvrtaysrM43024VLM4/FQJQUFDAoUOHSE5OBsBisbB69WqmTJmCn58fNpuN9u3bu44uXMiCBQuYNm0aUVFRZGVlcdlll9W4XllZGbNnzyYgIIB58+ZdemPiUWbZQoldtbva+Exb7yaoRkSkcblVsPipjIwM4uLiiI2NBX48jREdHc2kSZPw9fWt9zyvv/46RUVFPPLII7Ru3RqLxVJrGDEMg0mTJmG1Wnn44YdN6UM8y7nrKBZsz+dAUTG9ggKJCr5M11eIiEdw22DhdDrJyspi06ZNrrHOnTvTs2dPsrOziYyMrPdcw4cP56mnniI2Npby8nJmz55d62mLbdu28f777+N0Otm1axcAU6dOJSws7NIaEo8SExZcJUh40nlbEfFsbhMsrFYrVqvVtezr6+t6YT9fSkqK6+/JkyfXa+7LLruMF198sV7rDhs2jNzc3HqtKyIiIlW5TbAwQ0JCAgUFBdXGU1JS8Pf3rzK2du1atmzZUm1dHZ0QERG5eC0uWNRXdHQ00dHRDVeMiIiIB3Kbb94UERGR5k/BQkREREyjYCEiIiKmUbAQERER0yhYiIiIiGkULERERMQ0ChYiIiJiGgULERERMY2ChYiIiJhGwUJERERMo2AhIiIiplGwEBEREdMoWIiIiIhpFCxERETENAoWIiIiYhoFCxERETGNgoWIiIiYxm2ChcPhICIiArvdjt1uJyoqirS0NADmzZvHmDFjACgpKWHYsGHk5OS4tj1w4ACjRo2itLS0zn3s378fu91+wVrWrVvH2LFjiYqK4q233rr4pqRZWrPvMDc8txnf6au44bnNrNl3uKlLEhFpNlo1dQHnCw8PZ/HixQA4nU5GjhzJ8OHD2bt3LyEhITgcDqxWK0lJScTHx7Nx40a8vLyIj48nOTmZgICAWudOSUkhMzOT1q1b11nDN998Q1paGq+99hplZWVMmDCBAQMG4Ovra2qv4p7W7DtM7KrdruXcwmLXckxYcFOVJSLSbLhVsDhfSUkJXl5ebN26lYiICAYNGkR6ejpWq5X+/fszePBgli5dir+/Pzabjb59+9Y5X9euXXnppZeYMWNGnet99NFHhIWF4evri6+vL127duXgwYP06dPHzPbqtMvSBUf+iUbbX1Nyulmvz2btr3F8wfZ8BQsRkXpwq2CxZ88e7HY7FosFHx8f5syZw/Lly0lMTKR79+4kJCRQVFREUFAQcXFxREdHExgYSGpq6gXnHjFiBEePHr3geiUlJVx++eWu5YCAAEpKSi64XV5e3gXXqTdLF5xlTvPmc3Pu1OvXxTU/1vlfn6xy+u1iXOr2zYmn9OopfYLn9OopfULD9epWweL8UyEABQUFHDp0iOTkZAAsFgurV69mypQp+Pn5YbPZaN++Pd7e3qbV0KZNmyrXapSWllYJGrUJDQ3Fz8/PnCJycujXr585c7m5HDfrdeWOtuQWFlcb792x3SXV6W59NiRP6dVT+gTP6dVT+oRL67WsrKzON9Nuc/FmTTIyMoiLiyM1NZXU1FReffVVXnvtNZzOhnuH26dPH3JycigrK+P777+noKCAkJCQBtufuJdZttAax2faejdyJSIizZNbHbE4n9PpJCsri02bNrnGOnfuTM+ePcnOziYyMrJB9tuhQwfsdjsTJkzAMAzi4uLMOxIhbu/cdRQLtudzoKiYXkGBzLT11vUVIiL15DbBwmq1YrVaXcu+vr7s2rWr2nopKSmuvydPnvyz9nH11Vezbt26C64XFRVFVFTUz5pbWo6YsGAFCRGRi+Q2wcIMCQkJFBQUVBtPSUnB39+/ytjatWvZsmVLtXWnTp1KWFhYg9UoIiLSkrW4YFFf0dHRREdHN1wxIiIiHsitL94UERGR5kXBQkREREyjYCEiIiKmUbAQERER0yhYiIiIiGkULERERMQ0ChYiIiJiGgULERERMY2ChYiIiJhGwUJERERMo2AhIiIiplGwEBEREdMoWIiIiIhpFCxERETENAoWIiIiYpp6BYuPPvqIv/3tbzidTiZOnEh4eDg7d+5s6NpERESkmalXsJg/fz7XXXcd2dnZ+Pv7s3HjRl588cWGrk1ERESamXoFi8rKSgYOHMjbb7/N8OHD6dSpExUVFQ1dm0iDWrPvMDc8txnf6au44bnNrNl3uKlLEhFp9uoVLFq3bs1f//pX9uzZw6233srf//53AgICTC3E4XAQERGB3W7HbrcTFRVFWloaAPPmzWPMmDEAlJSUMGzYMHJyclzbHjhwgFGjRlFaWlrr/C+//DLR0dGMHTuWjIyMOmtZuXIl48ePZ/z48SxZsuTSmxO3s2bfYWJX7Sa3sJiKSoPcwmJiV+1WuBARuUSt6rPSc889R0ZGBkuWLKFt27YUFRXx/PPPm15MeHg4ixcvBsDpdDJy5EiGDx/O3r17CQkJweFwYLVaSUpKIj4+no0bN+Ll5UV8fDzJycm1hh2Hw8G+fftYvXo1p0+f5q9//WutNRw5coTMzEwyMjKwWCxMmDCBoUOH0rNnT9P7rc0uSxcc+ScabX9NydlEvT6btb/G8QXb84kJC27kakREWo56BYugoCDCw8M5ePAgvXv35pZbbqFjx44NWlhJSQleXl5s3bqViIgIBg0aRHp6Olarlf79+zN48GCWLl2Kv78/NpuNvn371jrX7t27CQkJ4fHHH6ekpIQZM2bUum7Hjh1ZsWIF3t7eAJSXl+Pn53fBevPy8n5+k7WxdMFZ5jRvPjfXFL1+XVxS43j+1yerHA0zU0PN6448pVdP6RM8p1dP6RMartd6BYtXX32Vbdu2cfz4cUaOHMncuXO5++67eeCBB0wtZs+ePdjtdiwWCz4+PsyZM4fly5eTmJhI9+7dSUhIoKioiKCgIOLi4oiOjiYwMJDU1NQ65z158iTHjh1j+fLlHD16lMcee4x//vOfWCyWauv6+PhwxRVXYBgGCxcupFevXgQHX/gdbGhoaL0CSL3k5NCvXz9z5nJzOU3U68odbcktLK423rtjuwapp6n6bAqe0qun9Ame06un9AmX1mtZWVmdb6brdY3Fxo0bSU1NpXXr1rRr147169fz2muvXVRBdQkPDyctLY2///3vpKamcvXVV3Po0CGSk5N56KGHsFgsrF69GgA/Pz9sNhsjRoxwHV2oTWBgIAMHDsTX15du3brh5+fHiRO1H34vKytj2rRplJaWMm/ePFN7FPcwyxZa4/hMW+9GrkREpGWpV7Dw8vLC19fXtezn53fBF3MzZGRkEBcXR2pqKqmpqbz66qu89tprOJ0/79B5v3792LVrF4ZhUFRUxOnTpwkMDKxxXcMwmDRpEj169CAxMbFR+pTGFxMWTPq9A+nTqR2tvCz06dSO9HsH6voKEZFLVK9TIf3792fBggWcPn2abdu2sXbtWsLDwxu0MKfTSVZWFps2bXKNde7cmZ49e5KdnU1kZGS957r11lv54IMPuPvuuzEMg7lz59YaGLZt28b777+P0+lk165dAEydOpWwsLBLa0jcTkxYsIKEiIjJ6hUsZsyYwbp16+jRowevv/46gwcPJiYmxtRCrFYrVqvVtezr6+t6YT9fSkqK6+/JkyfXe/66Ltg837Bhw8jNza33vCIiIvJ/6hUsHnroIVJTU00PE2ZLSEigoKCg2nhKSgr+/v5VxtauXcuWLVuqraujEyIiIhevXsHi9OnTFBYW0qlTp4au55IkJCTUe93o6Giio6MbrhgREREPVK9gceLECYYMGcKVV16Jn58fhmFgsVjYvn17Q9cnIiIizUi9gsWFvidCREREBOoZLD744IMax7t06WJqMSIiItK81StYOBwO199nz54lJyeHm266yfXDYCIiIiJQz2Dx7LPPVlkuLi4mLi6uQQoSERGR5qte37z5U5dddhlfffWV2bWIiIhIM1evIxbnfhgMfvzK66NHjzJo0KAGLUxERESan3oFi/O/4dJisdCuXTuuvfbaBitKREREmqd6nQrJzs6mf//+9O/fn1//+tdce+21zJw5s6FrExERkWamziMW//M//8ORI0fIy8vj0KFDrvHy8nK+//77Bi9OREREmpc6g8Vjjz3GV199RVJSEk888YRr3Nvbm+7duzd4cSIiItK81Bksrr76aq6++moyMzMpLi7m9OnTGIZBRUUFH3/8MREREY1Vp4iIiDQD9bp486WXXmLlypWUl5cTGBjI8ePHCQ0NJSMjo6HrExERkWakXhdvbty4kX/961/cdtttpKWlsWzZMtq1a9fQtYmIiEgzU69gcdVVV9GmTRuuu+46Dh48yC233EJhYWFD1yYiIiLNTL1OhbRp04bXX3+d3r17s2rVKq666irOnDnT0LWJiIhIM1OvIxZJSUmcOHECq9VKly5dmDt3LlOmTGng0kRERKS5qdcRi6CgIGJiYjh48CAzZszgzJkzXHbZZaYW4nA4mDJliusbPcvKyoiMjMRutzNv3jz279/P66+/TklJCXfddRfJycn069cPgAMHDvCHP/yB9evXExAQUOP8Y8aM4fLLLwd+/LTLT39Y7XwrV64kKysLgMGDB1f5qK00b2v2HSZ5ex4Hik7RK6gts2yhxIQFN3VZIiItRr2CxXvvvcfcuXOpqKhg7dq1REZG8txzzzFw4EBTiwkPD2fx4sUAOJ1ORo4cyfDhw9m7dy8hISE4HA6sVitJSUnEx8ezceNGvLy8iI+PJzk5udZQUVZWBkBaWtoFazhy5AiZmZlkZGRgsViYMGECQ4cOpWfPnuY1Kk1izb7DxK7a7VrOLSx2LStciIiYo17B4oUXXuAf//gHDz30EB06dGDVqlVMnTrV9GBxvpKSEry8vNi6dSsREREMGjSI9PR0rFYr/fv3Z/DgwSxduhR/f39sNht9+/atda6DBw9y+vRpJk6cSHl5OVOnTuWGG26ocd2OHTuyYsUKvL29gR+/ZdTPz68hWqzVLksXHPknGnWfTcXZiL0+m7W/xvEF2/MVLERETFKvYFFZWUmHDh1cyw31A2R79uxx/ZKqj48Pc+bMYfny5SQmJtK9e3cSEhIoKioiKCiIuLg4oqOjCQwMJDU1tc55/f39eeCBBxg/fjyff/45Dz30EP/85z9p1ap6+z4+PlxxxRUYhsHChQvp1asXwcEXftHJy8u76L6rsXTBWeY0bz4311i9fl1cUuN4/tcnycnJafD9N8Y+3IWn9OopfYLn9OopfULD9VqvYNGxY0feeustLBYL3333Henp6XTu3Nn0Ys4/FQJQUFDAoUOHSE5OBn78ZdXVq1czZcoU/Pz8sNlstG/f3nV0oTbBwcH84he/wGKxEBwcTGBgIN988w2dOnWqcf2ysjJmz55NQEAA8+bNq1ftoaGh5h3ZyMlxXT/S0uU0Yq8rd7Qlt7C42njvju0avIbG7LOpeUqvntIneE6vntInXFqvZWVldb6ZrvNTIUVFRQAkJiayefNmCgsLGTZsGB9//DGJiYkXVdDPkZGRQVxcHKmpqaSmpvLqq6/y2muv4XT+vHe469evd4WToqIiSkpKqhyBOZ9hGEyaNIkePXqQmJh4wdAizccsW2iN4zNtvRu5EhGRlqvOIxaPPvooGzdu5MorryQ0NJQXXnihserC6XSSlZXFpk2bXGOdO3emZ8+eZGdnExkZWe+57r77bp566inuueceLBYLzzzzTI2nQQC2bdvG+++/j9PpZNeuXQBMnTqVsLCwS2tImty56ygWbM/nQFExvYICmWnrresrRERMVGewMAzD9ffmzZuZOHFigxVitVqxWq2uZV9fX9cL+/lSUlJcf0+ePLlec/v6+vL888/Xa91hw4aRm5tbr3Wl+YkJC1aQEBFpQHUGC4vF4vr7/JDhrhISEigoKKg2npKSgr+/f5WxtWvXsmXLlmrr6uiEiIjIxavXxZtQNWS4q4SEhHqvGx0dTXR0dMMVIyIi4oHqDBaHDh3CZrMBP170eO5vwzCwWCxs37694SsUERGRZqPOYJGdnd1YdYiIiEgLUGew6NKlS2PVISIiIi1AvX7dVERERKQ+FCxERETENAoWIiIiYhoFCxERETGNgoWIiIiYRsFCRERETKNgISIiIqZRsBARERHTKFiIiIiIaRQsRERExDQKFiIiImIaBQsRERExjYKFiIiImEbBQkRERExT58+mizQXa/YdJnl7HgeKTtErqC2zbKHEhAU3dVkiIh6nUY5YOBwO4uLiqozNmjWLnTt3cvToUXr06MErr7xS5fZHH30Uu91eZd0VK1Zgt9u58847iYiIwG63Y7fbqaioqHG/GzZs4JZbbsFutzNhwgTuv/9+jh8/7rq9rKyMAQMGsGLFCtfY0aNHiYqKMqt1aQRr9h0mdtVucguLqag0yC0sJnbVbtbsO9zUpYmIeBy3OGLRtWtXsrOzefjhhwEoLi7miy++oH379lXWe/DBB3nwwQdxOBysWbOGxYsXX3Du0aNHM23aNADWrl3L8uXLmTt3LgDZ2dncdtttbNy4kYkTJ+Ll5R5nhnZZuuDIP9HUZTQKpwm9Ppu1v8bxBdvzddRCRKSRuUWwaNeuHYGBgRQUFNC9e3f+93//l5EjR/Lvf//b1P2cOnWKLl26uJYzMjL4n//5H06cOMG//vUvbr311oueOy8vz4wSf2TpgrPMad58bu5Se/26uKTG8fyvT5KTk3NJc5vJnWppaJ7Sq6f0CZ7Tq6f0CQ3Xq1sEC4Dbb7+drKwsnnzySbZv387UqVNNCRZbtmxh//79lJaW8tVXX7Fq1SoAPv/8c06fPk3Pnj0ZN24cf/3rXy8pWISGhuLn53fJ9QKQk0O/fv3MmcvN5ZjQ68odbcktLK423rtjO7e5H83os7nwlF49pU/wnF49pU+4tF7LysrqfDPtHsf+gaFDh7Jjxw6OHj1Khw4d8Pf3N2Xe0aNHk5aWxoYNG/jTn/7EpEmTgB+PVpw+fZoHHniA1NRUcnJy+OKLL0zZpzSuWbbQGsdn2no3ciUiIuI2RywCAgIIDg5m0aJFjB8/vkH20alTJ86ePUt5eTn/+7//y8aNGwkMDARg2bJl/OMf/3BdMCrNx7nrKBZsz+dAUTG9ggKZaeut6ytERJpAowWLd955h7Fjx7qWg4Or/6MfGRnJ3LlzeeGFF/j8889N2e+5UyHe3t6Ulpbyxz/+kR07dtC7d29XqAAYO3Ysd955J+PHj+fQoUNVap01axb9+/c3pR5pGDFhwQoSIiJuwGIYhtHURTRn5841mXmNhc7ztTye0id4Tq+e0id4Tq+e0ieYc41Fba97bnMq5FI88cQTnDp1qspYmzZtWLZsWRNVJCIi4plaRLBYsmRJU5cgIiIiuNGnQkRERKT5U7AQERER0yhYiIiIiGkULERERMQ0ChYiIiJiGgULERERMY2ChYiIiJhGwUJERERMo2AhIiIiplGwEBEREdMoWIiIiIhpFCxERETENAoWIiIiYhoFCxERETGNgoWIiIiYRsFCRERETNOqqQsQuRRr9h0meXseB4pO0SuoLbNsocSEBTd1WSIiHqvBj1g4HA4iIiKw2+3Y7XaioqJIS0sDYN68eYwZMwaAkpIShg0bRk5OjmvbAwcOMGrUKEpLS+vcxyuvvMLAgQMpKytzjc2aNYubbroJp9PpGsvPz6dHjx44HA6Sk5Ox2+2MHDmSW265BbvdzpNPPula94svvmD06NFm3AXSQNbsO0zsqt3kFhZTUWmQW1hM7KrdrNl3uKlLExHxWI1yxCI8PJzFixcD4HQ6GTlyJMOHD2fv3r2EhITgcDiwWq0kJSURHx/Pxo0b8fLyIj4+nuTkZAICAuqcf/Pmzdx2221kZWUxduxY13iHDh3YuXMnQ4cOda13zTXXAD8GD4ANGzbw2WefMW3aNNd2r7/+On//+985efKkqfdDfe2ydMGRf6JJ9t3YnJfQ67NZ+2scX7A9X0ctRESaSKOfCikpKcHLy4utW7cSERHBoEGDSE9Px2q10r9/fwYPHszSpUvx9/fHZrPRt2/fOudzOBx07dqVmJgYpk+fXiVY3H777WzZsoWhQ4dSWVlJfn4+v/rVry5YY9u2bVm1ahXDhg2rd195eXn1XveCLF1wljkvvF4LcbG9fl1cUuN4/tcnqxz5chfuWFND8ZRePaVP8JxePaVPaLheGyVY7NmzB7vdjsViwcfHhzlz5rB8+XISExPp3r07CQkJFBUVERQURFxcHNHR0QQGBpKamnrBuTMyMhg/fjzdunXD19eX/fv3u8JInz592Lp1Kz/88AMffvghVquVgoKCC8556623/uweQ0ND8fPz+9nb1Sgnh379+pkzl5vLuYReV+5oS25hcbXx3h3bud39dyl9Njee0qun9Ame06un9AmX1mtZWVmdb6Yb/VQIQEFBAYcOHSI5ORkAi8XC6tWrmTJlCn5+fthsNtq3b4+3t3ed8546dYqdO3dy4sQJ0tLSKCkpYdWqVVWOcgwZMoTt27fz7rvv8thjj1WpQ5q3WbZQYlftrjY+09a7CaoRERFook+FZGRkEBcXR2xsLADHjh0jOjqaSZMm4evrW+95MjMzGTduHDNnzgTg9OnT2Gw2Tpz4v3P2kZGRJCUlYbFY6Nq1q7mNSJM6dx3Fgu35HCgqpldQIDNtvXV9hYhIE2r0YOF0OsnKymLTpk2usc6dO9OzZ0+ys7OJjIys91wZGRksXLjQtdy6dWuGDx/OunXrXGPdunXj5MmTjBs3zpwGxK3EhAUrSIiIuJEGDxZWqxWr1epa9vX1ZdeuXdXWS0lJcf09efLkes2dmZlZbSwhIaHa2IYNG1x///RUyPkXe/7UO++8U686RERE5EfN4guyEhISarzoMiUlBX9//yaoSERERGrSbIKFiIiIuD/9VoiIiIiYRsFCRERETKNgISIiIqZRsBARERHTKFiIiIiIaRQsRERExDQKFiIiImIaBQsRERExjYKFiIiImEbBQkREREyjYCEiIiKmUbAQERER0yhYiIiIiGkULERERMQ0ChYiIiJiGgULERERMY2ChYiIiJimVVMXIHIp1uw7TPL2PA4UnaJXUFtm2UKJCQtu6rJERDxWgx+xcDgcREREYLfbsdvtREVFkZaWBsC8efMYM2YMACUlJQwbNoycnBzXtgcOHGDUqFGUlpbWuY9XXnmFgQMHUlZW5hqbNWsWN910E06n0zWWn59Pjx49cDgcJCcnY7fbGTlyJLfccgt2u50nn3wSgAULFhAdHc24ceNYt26dWXeFmGzNvsPErtpNbmExFZUGuYXFxK7azZp9h5u6NBERj9UoRyzCw8NZvHgxAE6nk5EjRzJ8+HD27t1LSEgIDocDq9VKUlIS8fHxbNy4ES8vL+Lj40lOTiYgIKDO+Tdv3sxtt91GVlYWY8eOdY136NCBnTt3MnToUNd611xzDfBj8ADYsGEDn332GdOmTQNgz549fPnll6xduxan08ntt9/OiBEjaNu2ren3S212WbrgyD/RaPtrSs5L6PXZrP01ji/Ynq+jFiIiTaTRT4WUlJTg5eXF1q1biYiIYNCgQaSnp2O1Wunfvz+DBw9m6dKl+Pv7Y7PZ6Nu3b53zORwOunbtSkxMDNOnT68SLG6//Xa2bNnC0KFDqaysJD8/n1/96ld1zhcWFsb111/vWq6oqKBVqwvfTXl5eRdcp94sXXCWOS+8Xgtxsb1+XVxS43j+1yerHPlyF+5YU0PxlF49pU/wnF49pU9ouF4bJVjs2bMHu92OxWLBx8eHOXPmsHz5chITE+nevTsJCQkUFRURFBREXFwc0dHRBAYGkpqaesG5MzIyGD9+PN26dcPX15f9+/e7wkifPn3YunUrP/zwAx9++CFWq5WCgoI65/Pz88PPz4+zZ88ya9YsoqOjL3jEBCA0NBQ/P7/63SEXkpNDv379zJnLzeVcQq8rd7Qlt7C42njvju3c7v67lD6bG0/p1VP6BM/p1VP6hEvrtaysrM43041+KgSgoKCAQ4cOkZycDIDFYmH16tVMmTIFPz8/bDYb7du3x9vbu855T506xc6dOzlx4gRpaWmUlJSwatWqKkc5hgwZwvbt23n33Xd57LHHqtRR17xPPvkk/fv355FHHrnIrqWhzbKFErtqd7XxmbbeTVCNiIhAE30qJCMjg7i4OGJjYwE4duwY0dHRTJo0CV9f33rPk5mZybhx45g5cyYAp0+fxmazceLE/52zj4yMJCkpCYvFQteuXS8455kzZ7j//vv53e9+xx133PEzO5PGdO46igXb8zlQVEyvoEBm2nrr+goRkSbU6MHC6XSSlZXFpk2bXGOdO3emZ8+eZGdnExkZWe+5MjIyWLhwoWu5devWDB8+vMonObp168bJkycZN25cveZcs2YNR44cISMjg4yMDACeeeYZ10Wf4l5iwoIVJERE3IjFMAyjqYtozs6dazLzGgud52t5PKVP8JxePaVP8JxePaVPMOcai9pe95rFF2QlJCTUeNFlSkoK/v7+TVCRiIiI1KTZBAsRERFxf/qtEBERETGNgoWIiIiYRsFCRERETKNgISIiIqZRsBARERHTKFiIiIiIaRQsRERExDQKFiIiImIaBQsRERExjYKFiIiImEbBQkREREyjYCEiIiKmUbAQERER0yhYiIiIiGkULERERMQ0ChYiIiJimlZNXYDIxVqz7zDJ2/M4UHSKXkFtmWULJSYsuKnLEhHxaA12xMLhcBAREYHdbufee+8lJiaGgoICXnrpJVavXg3AgAEDqm13/u31NW/ePMaMGVNlzG63M2rUqCpjb775Jj169ODo0aP84Q9/wG63M2TIEEaMGIHdbufpp592rbt//37sdvvPqkMaz5p9h4ldtZvcwmIqKg1yC4uJXbWbNfsON3VpIiIerUGPWISHh7N48WIAdu/ezcKFCwkNDTV1H6dPn2bv3r2EhITgcDiwWq1Vbv/444+5/vrrAcjKyqJLly4APP/888CPQaZ9+/bcc889rm1SUlLIzMykdevWptZaX7ssXXDkn2iSfTc250X2+mzW/hrHF2zP11ELEZEm1GinQr777jvXi7qZ3njjDSIiIhg0aBDp6elVgsXtt9/Oli1buP766/nuu+8oKyujffv2F5yza9euvPTSS8yYMaPedeTl5V1U/TWydMFZ5jRvPjd3Mb1+XVxS43j+1yfJycm51JIahLvW1RA8pVdP6RM8p1dP6RMartcGDRZ79uzBbrfjdDr5z3/+w8svv8z7779v6j4yMjJITEyke/fuJCQkUFRURFBQEABDhgxh5syZTJs2jezsbEaOHMk//vGPC845YsQIjh49+rPqCA0Nxc/P76J6qCYnh379+pkzl5vLucheV+5oS25hcbXx3h3bueV9d7F9Nkee0qun9Ame06un9AmX1mtZWVmdb6Yb9FMh4eHhpKWlsXbtWjZs2MDkyZM5c+aMafMXFBRw6NAhkpOTeeihh7BYLFWuz/Dz8+P6669n3759bN26lWHDhpm2b2las2w1n1KbaevdyJWIiMj5Gu1USH1OQfxcGRkZxMXFERsbC8CxY8eIjo5m0qRJrnVGjx7NypUradu2LQEBAabXIE3j3HUUC7bnc6ComF5Bgcy09db1FSIiTaxRToV4eXlRWlrKrFmz+Oqrr1y3FxcXM3bsWNfyxIkTAXjllVfIyMgAICAggLS0tGpzO51OsrKy2LRpk2usc+fO9OzZk+zsbNfYgAEDmDVrFs8++6zp/UnTigkLVpAQEXEzDRYsrFYr7733Xp3r5Ofn1zg+efLkC87v6+vLrl27qo2npKQAEBkZ6Rp79913XX+vW7euXvu6+uqrq60rIiIidWsWX5D1xBNPcOrUqSpjbdq0YdmyZU1UkYiIiNSkWQSLJUuWNHUJIiIiUg/6rRARERExjYKFiIiImEbBQkREREyjYCEiIiKmaRYXb7ozwzCAH79Xw0xlZWWmzufOPKVXT+kTPKdXT+kTPKdXT+kTLr7Xc693517/fspi1HaL1Mv333/PJ5980tRliIiINKqQkBAuv/zyauMKFpeosrKS0tJSfHx8sFgsTV2OiIhIgzIMg7NnzxIQEICXV/UrKhQsRERExDS6eFNERERMo2AhIiIiplGwEBEREdMoWIiIiIhp9D0WjaCyspKEhAT+85//4Ovry/z58/nFL37hun3Hjh0sXbqUVq1aMW7cOKKiomrd5osvvmDWrFlYLBauu+465s2bV+NVuU3hYvo8e/Yss2fP5quvvsLpdPLYY49hs9nIz8/n0Ucf5Ze//CUA99xzD7fddlsTdVbdxfQKMGbMGNfHs66++mqeffbZFveYbtiwgY0bNwI/fk7+448/5p133uHIkSPN+jEFOH36NL/73e9ISkqie/fuLfJ5CtX7bKnPU6jeK7S85ylU77NBn6eGNLjs7Gxj5syZhmEYxr59+4xHH33UdZvT6TSGDh1qFBcXG2VlZcbYsWON48eP17rNI488YuzZs8cwDMOYM2eO8eabbzZyN7W7mD7Xr19vzJ8/3zAMwzhx4oQxePBgwzAMY926dUZqamqj91BfF9PrmTNnjDvvvLPaXC3tMT1fQkKCsWbNGsMwmvdjahiG8dFHHxl33XWX8Zvf/Mb49NNP69ymuT6mhlFzny3xeWoYNffa0p6nhlFzn+cz+3nqHnGrhcvJyeHmm28G4IYbbiAvL891W0FBAV27dqVt27b4+vrSr18//v3vf9e6TX5+Pv379wdg0KBBvPvuu43cTe0ups+RI0fy+9//3rWet7c3AHl5ebz99tvExsYye/ZsSkpKGreZC7iYXg8ePMjp06eZOHEiv/3tb/nwww+BlveYnpObm8unn35KdHQ00LwfU/jx2waXLl1Kt27dLrhNc31MoeY+W+LzFGrutaU9T6HmPs9piOepgkUjKCkpoU2bNq5lb29vysvLXbed/81lAQEBlJSU1LqNYRiuL+IKCAjg+++/b6QuLuxi+gwICKBNmzaUlJTw5JNPMmXKFAD69OnDjBkzSE9P55prrmHp0qWN2suFXEyv/v7+PPDAA6SmpvLHP/6RadOmtcjH9JyXX36Zxx9/3LXcnB9TgH79+tGpU6d6bdNcH1Oouc+W+DyFmnttac9TqLnPcxrieapg0QjatGlDaWmpa7myspJWrVrVeFtpaSmXX355rducf06vtLSU//f//l8jdFA/F9MnQGFhIb/97W+58847iYyMBGDYsGGEhoa6/j5w4EBjtVEvF9NrcHAwd9xxBxaLheDgYAIDA/nmm29a5GP63Xff8dlnnxEeHu66vTk/pj93m+b6mNalpT1Pa9PSnqd1aajnqYJFI7jxxhvZuXMnAB9++CEhISGu27p3784XX3xBcXExTqeTf//734SFhdW6Ta9evXA4HADs3LmTm266qZG7qd3F9Pntt98yceJEpk+fzt133+1a/4EHHuCjjz4C4L333qN3796N28wFXEyv69evJzk5GYCioiJKSkro0KFDi3tMAT744AN+85vfVJmrOT+mP3eb5vqY1qYlPk9r09Kep3VpqOepvtK7EZy7YveTTz7BMAyeeeYZDhw4wA8//EB0dLTrynrDMBg3bhyxsbE1btO9e3cOHz7MnDlzOHv2LN26dWP+/Pmu851N7WL6nD9/Pm+88UaVc38pKSkUFBTw9NNP4+PjQ/v27Xn66aerHOprahfTq9Pp5KmnnuLYsWNYLBamTZvGjTfe2OIeU4AVK1bQqlUr7r//ftdc+fn5zfoxPcdut5OQkFDlUyEt6Xl6zvl9ttTn6Tnn99oSn6fnnN8nNNzzVMFCRERETKNTISIiImIaBQsRERExjYKFiIiImEbBQkREREyjYCEiIiKmUbAQ8VD33HMPWVlZVcZ++OEHrFYrJ06cqNccDz30EEVFRbXe7nA4sNvtNd7Wo0ePetd69OhRhgwZUu/1zVBb3SJSNwULEQ81btw4Nm/eXGXszTffxGq1csUVV9RrjpSUFIKCghqivCb3/vvvN3UJIs2SfjZdxEONGjWKhQsXUlxcTGBgIACZmZncd999vP/++yxevJgzZ87w3Xff8dRTTzF06FBmzZpFcXExX3zxBdOnT2f+/Pn8/e9/JzAwkNmzZ1NUVMTx48eJiIggKSkJgJMnT/LAAw9w/Phx+vTpw7x58/D19XXVUVpaSmJiIocOHaKiooKHHnqI0aNH11r3hg0bePvttykuLub48ePExMTw1VdfsWfPHgIDA1mxYgXffPMNjz32GN26dePTTz+lc+fOLFq0iMDAQN566y3+9Kc/UVlZyTXXXENiYiLt27dnyJAh9OnTh48//piIiAgAxo8fT0ZGBqtWrWLTpk2cPn0aHx8fnn/+ebp168aQIUO444472L17N6dPn2bBggWEhoby8ccfM3fuXM6cOUPbtm157rnn6NixI6+88gpvvPEGFRUVDBw4kOnTp7t+f0KkpdARCxEPFRAQgM1m45///Cfw49cXHz58mIEDB7Jq1Srmz5/Pxo0bmT9/Pi+++KJru8DAQN54440qpybefvttrr/+etauXUt2djYffPAB+fn5wI+nMebMmUNmZialpaWsXr26Sh3Lli2jd+/ebNiwgfT0dJYvX86RI0fqrD03N5e//OUvpKam8uyzzzJo0CDX0Zddu3YB8MknnzBhwgSysrLo3r07S5Ys4b///S9z585l6dKlbN68mRtvvJHExETXvIMGDSI7O5uEhAQAMjIyKCkpYdu2baSlpbFlyxZuueUW0tPTq9wf69evJyYmhpdffhmAadOmMWnSJDZv3sxtt93Gq6++ys6dO8nLy2P9+vW8/vrrFBUVkZmZ+bMeM5HmQEcsRDzY2LFjefHFF4mJiWHz5s3ccccdeHt7s2jRIt566y3++c9/sn///io/cNSnT59q84wePZqPPvqIlStX8tlnn1FcXMwPP/wAwE033cQvf/lLACIjI9mwYQP33Xefa9t3332XM2fO8NprrwE/Xudx6NAhrrnmmlrrvvHGG2nTpo3rq4bPHWHo0qUL3333HQC//OUvsVqtAIwZM4Zp06YxYMAA+vTpw9VXXw1AdHQ0r7zyimvevn37VttXmzZteP7558nKyuLzzz9n165dXH/99a7bz/1c9XXXXcebb77JiRMn+Oabb7j11lsBmDBhAgALFizgo48+YuzYsQCcOXOGzp0719qjSHOlYCHiwX7961/zzTffUFhYSGZmJkuWLAF+fDG0Wq1YrVYiIiKYNm2aaxt/f/9q86SlpZGdnU1UVBS/+c1vXL9ZAFT5lUXDMKr96mJlZSWLFi1y/djRt99+S9u2beus28fHp8pyTb/k+NP9ent7U1lZWWUdwzCq/Ly0n59ftXkKCwux2+3ce++9DBo0iPbt2/Pxxx9X2+bcKQ0fH58qpzfKyso4fvw4FRUV3Hffffzud78DfvxlSXf5rQkRM+lUiIiHGzNmDMuWLaNt27Z07dqV4uJiPv/8c37/+98zaNAgtm/fTkVFRZ1zvPPOO0RHR3PHHXdQVlbGwYMHXS/iOTk5HDt2jMrKSl5//fVqv6YYHh7uOj1y/Phx7rjjDgoLCy+5r8OHD7sCwGuvvcagQYPo27cv+/fv5+jRowCsXbvWdVTjp7y9vSkvLyc3N5df/OIX3H///fzqV79i27Ztdd4fl19+OUFBQezevRuATZs28eKLLxIeHs6mTZsoLS2lvLycxx9/nOzs7EvuU8Td6IiFiIcbO3YsQ4YMcV1sGRgYyN13383tt99Oq1atCA8P58yZM65TGzW57777SEhI4JVXXqFNmzaEhYVx9OhRunbtyrXXXsvs2bP55ptvCA8Pr/Kz2wBPPPEECQkJjB49moqKCqZPn07Xrl0vua+2bdvy5z//mS+//JIePXowf/58LrvsMhITE3niiSc4e/YsnTt3dvX9UzabjTvvvJN169axevVqbrvtNgzD4Ne//jWHDh2qc9+LFi0iISGBRYsW0a5dOxYuXMhVV13FwYMHiYqKoqKigptvvpm77rrrkvsUcTf6dVMRaXGOHj3Kb3/7W3bs2NHUpYh4HJ0KEREREdPoiIWIiIiYRkcsRERExDQKFiIiImIaBQsRERExjYKFiIiImEbBQkREREyjYCEiIiKm+f9hHD5z8pMuKAAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 576x360 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plot_model(tuned_rf, plot='feature')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "FfWC3NEhEQr9"
   },
   "source": [
    "### 10.4 Confusion Matrix"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "OAB5mes-EQsA",
    "outputId": "bd82130d-2cc3-4b63-df5d-03b7aa54bf52"
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAeoAAAFkCAYAAADv13iSAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy86wFpkAAAACXBIWXMAAAsTAAALEwEAmpwYAAAs/UlEQVR4nO3deXhM9x7H8U/2iF1U7Fw0toilRWutKF1ko7W0hFjbor1qC60laquIvaW0qK1oa6eoorhFxU5RetuqIKGpWBKyzbl/eDo1TSLcZpKD9+t55nkyv985v9/3HJP5OGfOnDgYhmEIAACYkmNuFwAAADJHUAMAYGIENQAAJkZQAwBgYgQ1AAAmRlADAGBiBDXsonLlygoICFBQUJCCg4P13HPP6aWXXtKxY8eybY5NmzYpJCQk28YLCQmRn5+fgoKCbB72dv36dXXu3Nmmbfv27QoJCVFQUJBatWqlfv366eLFi5KklStX6rXXXsvWGmJjY9WhQwdJ0o0bN9ShQwe1atVK69ats7b/E0lJSZo6daqCg4MVFBSkgIAAzZkzR//k26F31vn111/f9/pbt27VmDFj/u/5/65y5cry8/NLt00zZsxQ5cqVs3ztnzt3Tm+++WaGfXf+++DR45zbBeDhtWDBAhUpUsT6fO7cuRozZoyWL1+ei1Xd3eDBg/X888/n6JxXr161eRNft26dZs2apVmzZqlcuXIyDENz5sxR586dtWHDBrvU4OXlpWXLlkmSTp48qbi4OG3ZskWSFBAQ8I/GNgxDvXv31r/+9S8tX75cbm5uunLlil577TUlJiaqX79+/9e4f6/zfjVv3lzNmzf/v9bNjGEY2r9/v+rWrWt9vnHjRhUsWDDLdS9cuKBffvklw747/33w6CGokSNSU1N18eJF6xvW77//rhEjRiguLk6XL19WqVKlNHXqVHl6esrPz0+tW7fWnj17dPHiRQUFBVnfzKdNm6Z169apUKFCKleunHX869eva9SoUTp16pQcHBzUuHFj9e/fX87OzqpRo4a6du2q3bt3KzExUX379tWmTZt0+vRpFStWTB999JE8PDzuWn9MTIzCw8N1/vx5GYah4OBg9ejRQ9HR0erYsaMqVqyo8+fPa9GiRYqOjlZkZKRu3rwpR0dH9e3bV82aNdPly5cVFhamK1euSJKaNm2qfv36aejQobp165aCgoK0cuVKTZkyRaNHj7Zun4ODg3r16qUSJUooOTnZpq7Dhw9r4sSJSk5O1uXLl9WgQQONGzdOqampGj16tA4ePCgXFxeVLl1a48ePl5ubW4btV65cUUBAgFasWKF33nlHsbGxCgoK0uTJk/Xyyy/r0KFDkqRZs2bp66+/lsViUalSpTRy5Eh5eXkpJCREBQsW1M8//6xXXnnF5kxHVFSUfv75Z82ZM0dOTk6SpMKFCysiIkLnz5/Pcv+GhoaqadOmOnLkiK5du6ZBgwapYsWKd60zOjpaAQEBOnToUKb7feXKldq8ebNmz5593/O3aNEiw9dJYGCg1q5daw3qAwcOqFKlSrp165Z1mY8++khbt27VrVu3dPPmTYWFhcnPz0/Dhg1TbGysunfvrlGjRtm8rt5//31169ZNhw4d0tChQ5WYmKhp06bpzJkz6ty5sxYvXqyKFSve9TWMB5gB2IG3t7fh7+9v+Pv7Gw0bNjT8/PyM0aNHG7///rthGIbx6aefGrNnzzYMwzAsFovRo0cPY+7cuYZhGEazZs2M999/3zAMw4iJiTFq1Khh/Pbbb8aWLVuMF1980bh+/bqRkpJi9OrVy+jUqZNhGIYxePBgY/To0YbFYjGSkpKMbt26Wcf39vY2FixYYBiGYcyePduoXbu2ERMTY6SlpRmtW7c21q5daxiGYXTq1Mlo1qyZERgYaH18++23hmEYRseOHY158+YZhmEY165dMwICAoz169cb586dM7y9vY2oqCjDMAwjPj7eaNmypXHu3Dlr/U2aNDHOnz9vfPDBB8bw4cMNwzCMhIQEo1+/fsa1a9eMc+fOGbVq1TIMwzD++OMPw9vb20hMTMx0365YscLo1auXYRiG8fbbbxt79+41DMMwbty4YdSvX984duyYERUVZTz//POGxWIxDMMwIiIijAMHDmTafmcNe/fuNVq1amUYhmHTvmrVKqNfv35GSkqKYRiGsWzZMqNHjx7WfTd06NAM6507d67x1ltvZbo997J/t23bZhiGYWzatMl45pln7lrn359ntt/v3I//z/x/5+3tbZw+fdqoX7++kZSUZBiGYbzzzjvGtm3bjGbNmhlHjx41oqOjjZCQEOPmzZuGYRjG+vXrDX9//wy3587X1Z3bk5CQYLRs2dJYuXKl0apVK2PNmjV33bd48HFEDbv589T3Dz/8oF69eql+/fry9PSUJHXp0kX79+/X/Pnz9euvv+rMmTOqWbOmdd0/T0l6eXnJ09NTV69e1Z49e9SiRQvly5dPkvTSSy9p0aJFkqSdO3dq6dKlcnBwkKurqzp06KAFCxaoV69ekqTnnntOklS2bFl5e3vLy8tLklS6dGldvXrVOm9Gp74TExN18OBBzZs3T5KUP39+tWnTRjt37lTNmjXl7OysWrVqSbp9hHv58mX16dPHur6Dg4N+/PFHNW7cWL169dLFixfVoEEDDRgwQPnz57eZ39Hx9mUjFovlnvbx+++/r507d+qjjz7Szz//rKSkJCUmJqpKlSpycnJS27Zt1ahRIz333HPy9fXVtWvXMmyPjo7Ocq7t27fr2LFjeumll6w13rx509r/5JNPZrieo6PjXT+Lzmr/uri4qGnTppKkatWqKT4+/p72zZ8y2+/2mN/T01O+vr7avn27mjZtqv3792vUqFHW/lKlSikiIkLr1q3T2bNndeTIESUkJGQ41p2vqzt5eHhoypQpateunQIDAxUYGHhf+wMPHi4mg91Vr15dQ4cO1ZAhQ6yBMHHiRE2bNk2FCxdW+/bt1bBhQ5s3czc3N+vPDg4O1r47l/nzNKp0OzQcHBxsnqemplqfu7i4ZPjzvbBYLOmC5s7xXV1d5ex8+/+8aWlpqlixotasWWN9LF++XI0aNZKvr6+2bt2q9u3b6/z582rbtq2OHz9uM27BggVVvnx5HTlyJF0d//73v3Xq1Cmbtk6dOmnHjh2qUKGC+vTpo2LFiskwDBUoUEBr1qxRWFiYnJyc1K9fPy1ZsiTT9nvdDz169LBu14oVK7R06VJrf2YfH9SsWVPHjh1TWlqaTfvRo0c1aNCgLPevi4uL9T8wd/4b3+nO14gkpaSkWH/Oar9nx/x3Cg4O1tq1a7Vlyxb5+flZXxuS9MMPP6h9+/a6ceOGGjZsqB49emQ6zp2vq7/75ZdfVKhQIZ08eTLdxyF4+BDUyBH+/v7y9fXV+PHjJUn/+c9/1KVLFwUHB8vT01O7d+9O90b+d02aNNGmTZt07do1WSwWrVmzxtrXqFEjLV68WIZhKDk5WZ9//rkaNGiQLbXny5dPNWvWtAba9evXtXr16gzHr1Wrls6ePauoqChJty94eu655xQbG6vIyEjNnDlTzz77rN59911VqlRJZ86ckbOzs9LS0qxh0bdvX40dO1Znz56VdDv8Z86cqVOnTqlChQrWua5du6Zjx45p4MCBatmypWJiYvTbb7/JYrFo+/btCg0NVe3atfXmm28qODhYx48fz7T9XjRq1Ehffvmlbty4Ien29QKDBw/Ocr3atWurQoUKGj9+vJKSkiTdvkZhzJgxKl269H3t38wUKFBAKSkp+umnnyTJ5qK7zPb7n7Jj/js1b95chw4d0pIlS9S6dWubvqioKPn4+Khr166qV6+etm7dan3dOzk52fwHIzPR0dEaO3as5s2bpwoVKigyMvL/qhMPDk59I8cMHz5cgYGB2rVrl/r06aOIiAhNmzZNLi4uqlOnjn777be7rt+0aVP9+OOPeumll1SgQAFVqVLFeoHQsGHDNGbMGAUEBCglJUWNGzfW66+/nm21R0ZG6r333tPKlSuVnJysgIAAtWnTxnox1J+KFCmi6dOnKyIiQklJSTIMQxERESpdurS6dOmiIUOGyN/fX66urqpcubJatWolJycn+fr6qlWrVlqyZIkCAgJkGIb69++v1NRUJSUlqXr16lqwYIFcXV2tcxUoUEC9evVS69at5eHhIS8vL9WpU0dnz55V27ZttXPnTvn7+8vDw0MFCxbU6NGjVaJEiQzb70Xbtm0VGxurdu3aycHBQSVKlND7779/T+tOnz5dU6ZMUZs2beTk5CSLxaLg4GB17979vvZvZvLnz69BgwapZ8+eKlKkiM3HF5nt9/Xr11uX+afz38nNzU1+fn46ceKEvL29bfr8/f319ddf64UXXpDFYlGzZs109epV3bhxQ5UqVZKbm5tefvllTZkyJcOxU1NTNWDAAHXv3l3e3t4aMWKEAgIC1KBBAz3zzDP3XSseDA7G3T48AgAAuYpT3wAAmBhBDQCAiRHUAACYmOkuJrNYLEpISJCLi8s9fRUCAIAHmWEYSklJUd68ea1fBbyT6YI6ISFBp0+fzu0yAADIUd7e3jY34/mT6YL6z5tRdJ81RJeuxeVyNcCj45dFe5SUdjPrBQFkK4c0J50+fTrTmzGZLqj/PN196VqcLl65lMvVAI8ONzc3GVncdAZA9nNIvX2Xxcw+7uViMgAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIaqRTrZy3jC3R6R4Nq9eVJLV4ookOfbRZiet/0pHZW/R83WbWdUeG9M9wXWNLtIZ36pdurvLFy+jamlPq0rJtTm0e8MCIjY1Vj6499a/SFVTcs6QCXgjUD8d/sPY3fKqx8jjntXm80at3hmNNjpyiPM55c6p0ZCNnew6elpamqVOnatWqVUpISFDjxo01YsQIFS1a1J7T4h/yKV9Zl+PjVKPXszbtcdeuqGrZx7X2vXkavWSaVuz6Sh39Wmt1+Ceq0/sFnTh7WpFffKSP1i+yWW9kyNtq0+gFzd24zKbdwcFBCwdPVX6PfHbfJuBBY7FY1P6lV2QYhj5f+bny5curMe+N04stW+ngsQMqUqSIfjz5o+YvmqdnmjW1rufh4ZFurOPHjuu9kaNzsnxkI7seUc+YMUOrVq3ShAkTtHjxYsXExOjNN9+055TIBj7lK+vEb2cUe+WyzSM1LVX/bt1de08e0rjPZujHc//ViAWR2n3igP7durskKeFWos06/ypeRr1e7KguEW/rQlyMzTxh7XvLMAylpqXmxmYCpnb0yFF9v/d7zf5klurWe1JVq1XVvAWf6MaNBG36apN++fkXJSQk6Kmn6qt48eLWR4ECBWzGSU5OVrcu3VX/qfq5tCX4p+wW1MnJyVq4cKH69++vhg0bqnr16po8ebIOHjyogwcP2mtaZAOf8lV08rczGfY1rlFP3x7ZY9P27ZE9alyjXobLT+v9nlb85ytt3v+tTXvNitU0sO3rCp3YP1tqBh42ZcqW0co1K+Rd2dva5ujoKMMwdOVKvH744YTy5MmjsuXK3nWc8OGjVLJkSYV262zvkmEndgvqU6dOKSEhQfXq/fUGXrp0aZUqVUr79++317TIBj7/qqxyxUprz/S1urj8oLZMWKq6lWtJkkoXLaHzv9seGV+Ii1WZx0qmGyfw6Zaq87iP3pk3wabd1cVVi8Km6935E/RLzG922w7gQebp6akXWj0vR8e/3qY/nDFTt27d0rMtmuvE8RMqWKigQkO66l9lKurJWnU1bcp0WSwW6/L/2fWdFi1YrJlzZubGJiCb2C2oY2Juv5l7eXnZtBcrVszaB/Nxd3VXheJlVTBvfg2aM0aBI7rpQlysdkz6UlXKVpKHex7dSkmyWScpJUnurm7pxurXpoe+2Lle/73wq037+G5DdCEuRrPXL7bnpgAPlfXrNmjEuyP1Vr83VaVqFZ04cUIJNxLUouWzWvfVGr32xmsaM2qsxr43TpJ0/fp19ejaU5FTJ6pkyRK5XD3+CbtdTHbz5k05OjrKxcXFpt3V1VVJSUmZrIXcdiv5lgq3qa6klGQlpyRLkkInvq0nHq+h3gFddDPpltxcXG3WcXNxU8KtRJu2UkVLqFmtBmo2sJ1Ne1Pfp9WlZVv59mph3w0BHiKLFixS79f6qm37lzVuwlhJ0txPP9GNGzdUqFAhSZJPDR9dvXpVEeMnatjIdzWg30DVeaKO2ndod5eR8SCwW1C7u7vLYrEoNTVVzs5/TZOcnKw8efLYa1pkg+uJN2yeG4ahH86eVpnHSujc5QsqUaSYTX9JT690p8ODGrTUhbgY7Thq+3l2l5Yvq2De/Ppx/g5rm7OTsz7693i1bxqoF98NyeatAR5sE8ZFKHzEKL3e53VNnhopBwcHSZKzs7M1pP/k41Nd169f19WrV7VowWK5u7uraMHbv6+pqbcv2ixasJhmzJquV17tkKPbgf+f3U59lyhx+1TL5cuXbdovXbqU7nQ4zKPO4zV0dfVJ1a7kY21zdHRUrYrV9cPZ0/rP8Sg19X3KZp1mtRpo57Hvbdoa+9TTjqN7ZRiGTXvYJ+NUpdszqvX6c9ZHalqqRiyYpB6TB9lvw4AH0KSJkxU+YpRGhA/XlGmTrCEtSU0aPKOB/W1/Zw4eOKQSJUuoUKFCOn7qqPYf3qfvD+zR9wf2KHz0SEnS9wf2yD+gVY5uB/4Zux1RV6lSRXnz5tW+ffsUFBQkSYqOjtb58+dVt25de02Lf+jIf0/o19hozXl7gvrMGKYbNxMU1r63ihYoommr5sqr0GM6MPMrhXceoKXbV+tVv9aqX6W23pg+1Gac2pV8tGDLF+nGvxwfp8vxcenaL8X/nu7rW8Cj7NjRYxo5LFxdunZW1x6hNtf25M+fX0GtAzU6fIxq166lpxs8rZ07dmnSxMmKnDJRklSxUkWb8by8imXYDvOzW1C7urrq1VdfVUREhAoXLixPT0+NGjVK9erVU61atew1Lf6hNEuaXngnRBE939W69+Yrr7uHvjsRpSYDXrKGbOvwHoro+a7C2r+hU+f+q4DhoTr1208245QoUkxx167k0lYAD74vln+ptLQ0LZi/UAvmL7TpGzlqhMLeGSxnZ2e9Py5C5347pzJlyyhi0gR17R6aOwXDbhyMv5+bzEapqamKjIzUqlWrlJqaar0zWZEiRTJdJykpScePH1fAhJ66eOWSvUoD8DfGlmjdSkvMekEA2coh1UnHjx+Xj4+P3NzSf4PGrrcQdXZ21pAhQzRkyBB7TgMAwEOLP8oBAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJ3VNQJycnS5LOnj2rb7/9VhaLxa5FAQCA27IM6g8++EBDhgzRhQsX1LFjR3366acaN25cTtQGAMAjL8ug3rZtm8aNG6f169crMDBQn376qQ4ePJgTtQEA8MjLMqgtFovc3d21fft2NW3aVBaLRTdv3syJ2gAAeORlGdRPP/20/P39lZKSorp166pTp07y8/PLidoAAHjkOWe1QFhYmEJCQuTl5SVHR0eNGDFCVapUyYnaAAB45GV5RH306FFt3rxZaWlp6tatm0JDQ7Vz586cqA0AgEdelkE9ZswYPf7449q8ebPc3d21atUqTZs2LSdqAwDgkXdPF5M1atRI3377rVq2bKkSJUooLS0tJ2oDAOCRl2VQ58mTR/PmzdPevXvVrFkzLVy4UHnz5s2J2gAAeORlGdSRkZFKTEzUjBkzVLBgQcXGxmry5Mk5URsAAI+8LIPay8tLfn5+slgsioqKUuPGjbVr166cqA0AgEdell/PGjZsmPbt26erV6+qQoUKOnXqlOrUqaOXX345J+oDAOCRluUR9e7du7VhwwY999xzGj16tBYuXKhbt27lRG0AADzysgzqYsWKycXFRRUrVtSPP/6oGjVq6Pr16zlRGwAAj7wsT317eXlp9uzZevrppzVx4kRJf/3ZSwAAYF9ZHlGPHTtWpUuXlq+vr1q2bKn169crPDw8B0oDAACZHlFfuHDB+nPt2rV14cIFNW/eXM2bN8+RwgAAwF2CulOnTpmu5ODgoK1bt9qlIAAA8JdMg3rbtm05WQcAAMjAXT+jXrFihY4ePWp9PnnyZK1YscLuRQEAgNsyDepFixZp2bJlypcvn7WtUaNG+uyzz/TZZ5/lSHEAADzqMg3qL7/8UvPnz1eFChWsbfXq1dPHH3+sZcuW5UhxAAA86jINakdHR5uj6T8VKVJEjo5ZfqsLAABkg0wvJnNyclJcXJw8PT1t2n///fcc+XvUBY/d1K3YRLvPA+Av7k4euV0C8MhJSk26a/9dv57Vs2dPDR48WNWqVZObm5uOHTumCRMmqEOHDtle6N9t3rNBzq5Odp8HwG1FihTRhcvRuV0G8MipXesJLV68ONP+TIM6ODhYSUlJGjp0qGJiYiRJZcqUUbdu3XIkqAEAQBb3+m7fvr3at2+vK1euyNHRUQULFsypugAAgO7hj3JIUuHChe1dBwAAyACXbwMAYGIENQAAJpZlUF+9elXDhg1T586dFR8fr6FDh+rq1as5URsAAI+8LIN6+PDhqlGjhuLj4+Xh4aFixYpp0KBBOVEbAACPvCyDOjo6Wu3bt5ejo6NcXV319ttvW7+uBQAA7CvLoHZyctL169fl4OAgSfr111+5hSgAADkky69nvfnmmwoJCdHFixfVu3dvHT58WOPGjcuJ2gAAeORlGdRNmjSRj4+Pjh49qrS0NL333nsqWrRoTtQGAMAjL8ug/uCDD2yenzx5UpLUt29f+1QEAACs7uvD5pSUFG3btk1xcXH2qgcAANwhyyPqvx859+nTR926dbNbQQAA4C/3ffl2QkKCLly4YI9aAADA32R5RO3n52f9apZhGLp69ap69Ohh98IAAMA9BPXUqVPl6ekpSXJwcFCBAgWUL18+uxcGAADuIajDwsK0cePGnKgFAAD8TZZBXaVKFa1evVq+vr5yd3e3tpcsWdKuhQEAgHsI6iNHjujIkSM2bQ4ODtq6davdigIAALdlGtSrVq1S69attW3btpysBwAA3CHTr2ctXLgwJ+sAAAAZ4M9gAQBgYpme+j5z5oyaN2+ert0wDD6jBgAgh2Qa1OXKldOcOXNyshYAAPA3mQa1i4uLSpUqlZO1AACAv8n0M+o6derkZB0AACADmQb1iBEjcrIOAACQAa76BgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGrc1eA3h2pg7zCbth3f7FSLp15QRc/Kerbe89q2ebtN/7FDx9W+VUdVLVlDdSrW08DeYbryR7y1/8b1GxoxMFx1KzeQt1d1BT/7svbtjsqJzQEeWN/v3ad8bgW089ud1rbPFn+mJ2o+Kc8Cj6nx0021dcvWDNdNSkpSvTr1tXTJ0pwqF9mIoEaGDMPQxNGTtWSe7S/26ZNn1LVdD/m3aaXNuzeopX8Lde/wmn48cVqSFHMxVh0COqps+TJau22VZi+eqcP7j+j1kD7WMQb2CdO3W3dq6pxIbfzPOvnW8tErgSH675mfc3QbgQdFQkKCuof2UFpamrVt2dLl6tG1lzq80l579+9Wx5BX9XLrdjZBLknXr19X+5c66NjR4zldNrJJjgX1iBEj9O677+bUdPgHzv7ym9q++IoWfrJYpcqUsun7ZOY81alXW/8e3FeVKlfS4BED9MRTdTR35nxJ0tov18nNzU3vTx+rx6tUUt2nn9TYKe/pP99+p/PnzuvKH/Fav/Irhb8/XA2bNlDFxyto1MSRKl7CS2u/XJcbmwuYXtjAISpVyvZ3cUrkFLV/pZ0GDRmkx70f1+u9X9MrHTto7Ojx1mW2fbNN9Z94WpcuXcrpkpGN7B7UhmFo2rRpWr58ub2nQjY58P1BlStfVlu/36Sy5Uvb9O3bHaWnGz9l09ag8VP6fvc+SVLLVi00a+EHcnJysvY7Ot5+mcVfuSo3N1ctWjlf9RrUtfY7ODhIDg6Kv3LVXpsEPLA2fbVJG7/apElTJ9q0/3Tmv2rYqKFNW81aNbV3z16lpqbeXnfjZnUJ7aztu7blWL3Ifs72HPzcuXN65513dObMGZUsWdKeUyEbtekQrDYdgjPsu3g+RsVLFrdp8yrhpQvRFyVJ5SuUU/kK5Wz6P5z8kYqXLK4q1SvLyclJzVo+Y9O/YfVG/frfX9WsRdNs2wbgYfD777/rjdf6aPbHs1SocGGbvhIlSyj6XLRN29lfzyo5OVnx8fEqWrSoIiZNyMlyYSd2PaI+dOiQypQpo3Xr1ql06dJZrwDTu5l4U25ubjZtrq6uSrqVlOHy44a/r282btX4qaNtjrL/dDDqkAa8MVgvBr+gZwhqwEbfN95SK/8X1fL5lun6Xu34ij6aOVvbt25XWlqadmzfoQXzF0qSkpNTcrpU2JFdj6gDAwMVGBhozymQw9zzuCs5OdmmLTk5WR55PWza0tLS9G7/EVo89zONnzZGLVu1SDfW9q+/1WshfVT7yVqa/skUu9YNPGgWL1ysI4ePKOrQ9xn2DwwboEuXLyvIv7XS0tJUrXpV9Rvwb414d6QKFiyQw9XCnrjqG/elZOkSio2xvTAl9mKsipf0sj6/deuWund4TcsWfK4Zc6cqpHvHdON8vvhLhbbtoSZ+jbRw5TzlyeNu99qBB8miBUt0Pvq8ypeqoKIFi6lmtVqSpCD/1nqz91tydXXV1OmTdTk+Vv/97YyiDu2Th4eHvLyKKW/evLlbPLKVXY+o8fCp93Rd7d31vTTkr7bdO/eofsN6kiSLxaLXOvXRdzt269MvPsnwdPaaL9ep/+uD9GpoB42fNibDU+LAo27ewrm6dfOm9XlMTKyefaaFZs75UM2f9VP48FHKlz+fBg4eoOLFb183sm7NOjVv0Ty3SoadENS4L11f76IXGgUocsxkBbcN1KrP1+pQ1GGNnzpWkrTw48X6ZuNWRc6coGo1qurSHUffhT0LK/6PeA3qM0RN/Bpp4LC3FXc5ztqfxyOP8hfIn+PbBJhRqVK2F+C6ud8+61SqZEkVK1ZM5cqX05BBQ+XjU12Vq1TWjOkf6sD+g5r+4bTcKBd2RFDjvlT1qaJPls3W2GHjNXPyR6roXVHzv5irx6tUkiStXL5aktLdzUySVm35QqdPnVHCjQTt2LpLtSvWs+l/pUt7Rc7kKlXgXnTtHqrYmFj17f2W4q/E64knn9DGLV/Ju7J3bpeGbOZgGIaRExOFhISobNmyGjt27F2XS0pK0vHjx/VYxcJyduWUKJBTfErX1oXL0VkvCCBb1fZ5QosXL5aPj0+6b9VIXEwGAICp5dip70WLFuXUVAAAPDQ4ogYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEyMoAYAwMQIagAATIygBgDAxAhqAABMjKAGAMDECGoAAEzMObcL+DvDMCRJaSlpuVwJ8Gjx8vJSclJybpcBPHKKFi0q6a/8+zsHI7OeXHL9+nWdPn06t8sAACBHeXt7K3/+/OnaTRfUFotFCQkJcnFxkYODQ26XAwCAXRmGoZSUFOXNm1eOjuk/kTZdUAMAgL9wMRkAACZGUAMAYGIENQAAJkZQAwBgYgQ1AAAmRlADAGBiBDUAACZmuluI4sFx+PBh7d+/XzExMUpKSlKePHnk5eWlunXrytfXN7fLA4CHAjc8wX2Li4vTW2+9pQMHDqhUqVIqVqyYXF1dlZycrEuXLun8+fOqX7++pk2bpkKFCuV2uQDwQCOocd/eeustxcbGavLkySpVqlS6/ujoaA0YMEClS5fWpEmTcqFCAHh4ENS4b7Vr19Znn32mqlWrZrrMDz/8oNDQUEVFReVgZcDDb/jw4fe87OjRo+1YCXIKn1HjvuXNm1fx8fF3XeaPP/6QszMvLyC7OTg46PPPP1fJkiUzPKN153J4OPBOivvWunVrhYWFqX///qpXr568vLzk5OQki8Wiy5cva9++fZowYYKCg4Nzu1TgofPee+/J09NTy5cv19SpU+Xp6ZnbJcHOOPWN+2axWDR9+nQtWrRIiYmJkiRHR0dZLBZJkoeHh1599VX169dPTk5OuVkq8NDq3LmzypYtqzFjxuR2KbAzghr/t5SUFJ08eVKxsbG6efOm3N3dVbx4cVWpUkWurq65XR7wUDt37pwOHz6sgICA3C4FdkZQAwBgYtyZDAAAEyOoAQAwMYIayGHR0dHy8fFRUFCQgoOD1apVK3Xt2lUxMTH/95grV67UkCFDJEk9e/ZUbGxspstOnz5d+/fvv6/xK1eunGH7zz//rNdff10BAQEKCAjQgAED9Mcff0iSZsyYoRkzZtzXPADSI6iBXFCsWDGtWbNGq1ev1oYNG1S5cmVFRERky9gff/yxvLy8Mu2PiopSWlraP54nNjZWnTt3Vrt27bRu3TqtXbtWjz/+uPr27fuPxwbwF75HDZhA/fr1NXnyZEmSn5+ffH19dfLkSX322WfatWuXFixYIIvFourVq2vkyJFyc3PT6tWrNWvWLOXLl0+lSpWSh4eHdf2FCxfqscce06hRo3TgwAG5uLiod+/eSk5O1vHjxzVs2DB98MEHcnd3V3h4uOLj4+Xu7q7hw4erWrVqio6O1qBBg5SYmKiaNWtmWPPSpUv11FNPyc/PT9LtG2z07NlTpUuXVmpqqs2yixcv1po1a3Tz5k25uLho0qRJqlChgiZMmKDvvvtOjo6OevbZZ9W3b1/t2bNHEydOlCQVLFhQkyZNUpEiRey16wHT44gayGUpKSnavHmzatWqZW1r0qSJNm/erD/++EOff/65li1bpjVr1sjT01Nz585VbGysIiMjtWTJEi1fvlwJCQnpxv3ze+4bN27U/Pnz9eGHH+rFF1+Uj4+PxowZo8qVKyssLEyDBg3SqlWrNHr0aL399tuSbt96sk2bNlqzZo3q1KmTYd0nT55U9erVbdqcnJzk7+9vc1e6Gzdu6JtvvtGiRYu0fv16PfPMM1qyZInOnz+vnTt3au3atVq6dKl++uknJSUlaebMmQoPD9fKlSvVoEEDnThxIhv2MvDg4ogayAWXLl1SUFCQJCk5OVm+vr4aMGCAtf/Po9jvv/9eZ8+eVbt27STdDvVq1arp0KFDql27tooWLSpJCggI0N69e23miIqKUrt27eTo6KjHHntMGzZssOlPSEjQ8ePHNXToUGtbYmKirly5on379ln/oEpgYKCGDRuWbhscHBzu6fvy+fLl06RJk7Rhwwb9+uuv2rVrl6pWrSovLy+5ubmpQ4cOatasmQYOHCg3Nzc1b95cffv21bPPPqvmzZurYcOGWc4BPMwIaiAX/PkZdWbc3NwkSWlpaXrhhResQZmQkKC0tDTt2bNHd94CIaP7qjs7O9vc7/ns2bMqUaKE9bnFYpGrq6tNHTExMdY/Tfrn+A4ODnJ0TH/yzcfHR8ePH7dps1gseuuttxQeHm5tu3jxokJCQtSpUyc1adJERYsW1cmTJ+Xs7KwvvvhC+/bt086dO9WhQwctWrRIoaGhatasmbZv366JEyfq6NGjeuONNzLdV8DDjlPfgInVr19fW7ZsUVxcnAzDUHh4uBYsWKAnnnhChw8fVmxsrCwWi7766qt069atW1dfffWVDMNQXFycOnXqpOTkZDk5OSktLU358+dX+fLlrUH93XffqWPHjpKkBg0aaO3atZKkr7/+WklJSenGb9++vXbs2KEdO3ZIuh3sM2fOVFxcnPVIX5KOHTumcuXKKTQ0VDVq1NA333yjtLQ0nThxQp06dVLdunUVFhamihUr6pdfflHbtm2VkJCg0NBQhYaGcuobjzyOqAETq1Klivr27asuXbrIYrGoatWq6tWrl9zc3DRs2DCFhoYqT548qlSpUrp1X331VY0ZM0aBgYGSbv95xHz58qlx48YaOXKkJkyYoIkTJyo8PFyffPKJXFxcNGXKFDk4OGjEiBEaNGiQli9fLh8fH+XNmzfd+I899pg+/vhjRUREKDIyUmlpaapWrZo+/PBDm+UaNmyopUuX6sUXX5RhGKpbt67OnDmjatWqqVatWvL391eePHlUp04dNWnSRHny5NGQIUPk7OwsDw8P7mWNRx63EAUAwMQ49Q0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIn9D15Hq4ua26vYAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 576x396 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plot_model(tuned_rf, plot = 'confusion_matrix')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "deClKJrbEQsJ"
   },
   "source": [
    "*Another* way to analyze the performance of models is to use the `evaluate_model()` function which displays a user interface for all of the available plots for a given model. It internally uses the `plot_model()` function. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 436,
     "referenced_widgets": [
      "42d5400d235d40b78190016ef0dabe11",
      "41031579127f4a53b58957e601465083",
      "12bf8b3c6ae8444a900474912589fdf1",
      "9bb3600d38c04691b444ff375ad5e3f5",
      "8886001bc7c1463ba58a8453f5c55073",
      "0a06fb091bd94ce6b6ab892e2c6faadf",
      "3cc1e83b91f34b289c7d52003f20a97a",
      "8d709ec9ec484944b1f9773748857f84",
      "8399e21b17634116861a5abaa9c0ccf7",
      "d5b6fce1763b4b54898ff3397b0f5bb0",
      "57b94ac505d142769b79de2f1e5c1166",
      "2a81017413ca4fe789c2272a5831a069",
      "02771b4dc3284414ab05df1906f4556b",
      "9e338844e75b4e17be8483529f5f38fd",
      "22588a12c0db4067982e62ebbe7e6930"
     ]
    },
    "colab_type": "code",
    "id": "OcLV1Ln6EQsN",
    "outputId": "7b5b8b4e-8d4a-4371-9a4f-cabb0a96265a"
   },
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "c500d286615a4ea5817df6d11f214817",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "interactive(children=(ToggleButtons(description='Plot Type:', icons=('',), options=(('Hyperparameters', 'param…"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "evaluate_model(tuned_rf)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "RX5pYUJJEQsV"
   },
   "source": [
    "# 11.0 Predict on test / hold-out Sample"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "mFSvRYiaEQsd"
   },
   "source": [
    "Before finalizing the model, it is advisable to perform one final check by predicting the test/hold-out set and reviewing the evaluation metrics. If you look at the information grid in Section 6 above, you will see that 30% (6,841 samples) of the data has been separated out as test/hold-out sample. All of the evaluation metrics we have seen above are cross validated results based on the training set (70%) only. Now, using our final trained model stored in the `tuned_rf` variable we will predict against the hold-out sample and evaluate the metrics to see if they are materially different than the CV results."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "nwaZk6oTEQsi",
    "outputId": "d30c8533-d347-4fa6-f18e-5b2abc937bec"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Model</th>\n",
       "      <th>Accuracy</th>\n",
       "      <th>AUC</th>\n",
       "      <th>Recall</th>\n",
       "      <th>Prec.</th>\n",
       "      <th>F1</th>\n",
       "      <th>Kappa</th>\n",
       "      <th>MCC</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Random Forest Classifier</td>\n",
       "      <td>0.8135</td>\n",
       "      <td>0.7563</td>\n",
       "      <td>0.3245</td>\n",
       "      <td>0.6591</td>\n",
       "      <td>0.4349</td>\n",
       "      <td>0.3383</td>\n",
       "      <td>0.3688</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                      Model  Accuracy     AUC  Recall   Prec.      F1   Kappa  \\\n",
       "0  Random Forest Classifier    0.8135  0.7563  0.3245  0.6591  0.4349  0.3383   \n",
       "\n",
       "      MCC  \n",
       "0  0.3688  "
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "predict_model(tuned_rf);"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "E-fHsX2AEQsx"
   },
   "source": [
    "The accuracy on test/hold-out set is **`0.8135`** compared to **`0.8225`** achieved on the `tuned_rf` CV results (in section 9.3 above). This is not a significant difference. If there is a large variation between the test/hold-out and CV results, then this would normally indicate over-fitting but could also be due to several other factors and would require further investigation. In this case, we will move forward with finalizing the model and predicting on unseen data (the 5% that we had separated in the beginning and never exposed to PyCaret).\n",
    "\n",
    "(TIP : It's always good to look at the standard deviation of CV results when using `create_model()`.)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "r79BGjIfEQs1"
   },
   "source": [
    "# 12.0 Finalize Model for Deployment"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "B-6xJ9kQEQs7"
   },
   "source": [
    "Model finalization is the last step in the experiment. A normal machine learning workflow in PyCaret starts with `setup()`, followed by comparing all models using `compare_models()` and shortlisting a few candidate models (based on the metric of interest) to perform several modeling techniques such as hyperparameter tuning, ensembling, stacking etc. This workflow will eventually lead you to the best model for use in making predictions on new and unseen data. The `finalize_model()` function fits the model onto the complete dataset including the test/hold-out sample (30% in this case). The purpose of this function is to train the model on the complete dataset before it is deployed in production."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "_--tO4KGEQs-"
   },
   "outputs": [],
   "source": [
    "final_rf = finalize_model(tuned_rf)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 147
    },
    "colab_type": "code",
    "id": "U9W6kXsSEQtQ",
    "outputId": "794b24a4-9c95-4730-eddd-f82e4925b866"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "RandomForestClassifier(bootstrap=True, ccp_alpha=0.0, class_weight=None,\n",
      "                       criterion='gini', max_depth=10, max_features='auto',\n",
      "                       max_leaf_nodes=None, max_samples=None,\n",
      "                       min_impurity_decrease=0.0, min_impurity_split=None,\n",
      "                       min_samples_leaf=2, min_samples_split=10,\n",
      "                       min_weight_fraction_leaf=0.0, n_estimators=70, n_jobs=-1,\n",
      "                       oob_score=False, random_state=123, verbose=0,\n",
      "                       warm_start=False)\n"
     ]
    }
   ],
   "source": [
    "#Final Random Forest model parameters for deployment\n",
    "print(final_rf)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "kgdOjxypEQtd"
   },
   "source": [
    "**Caution:** One final word of caution. Once the model is finalized using `finalize_model()`, the entire dataset including the test/hold-out set is used for training. As such, if the model is used for predictions on the hold-out set after `finalize_model()` is used, the information grid printed will be misleading as you are trying to predict on the same data that was used for modeling. In order to demonstrate this point only, we will use `final_rf` under `predict_model()` to compare the information grid with the one above in section 11. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "NJDk3I-EEQtg",
    "outputId": "4d75663a-e86f-4826-c8e4-c9aa722648df"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Model</th>\n",
       "      <th>Accuracy</th>\n",
       "      <th>AUC</th>\n",
       "      <th>Recall</th>\n",
       "      <th>Prec.</th>\n",
       "      <th>F1</th>\n",
       "      <th>Kappa</th>\n",
       "      <th>MCC</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Random Forest Classifier</td>\n",
       "      <td>0.8345</td>\n",
       "      <td>0.8222</td>\n",
       "      <td>0.3629</td>\n",
       "      <td>0.7657</td>\n",
       "      <td>0.4924</td>\n",
       "      <td>0.4082</td>\n",
       "      <td>0.4489</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                      Model  Accuracy     AUC  Recall   Prec.      F1   Kappa  \\\n",
       "0  Random Forest Classifier    0.8345  0.8222  0.3629  0.7657  0.4924  0.4082   \n",
       "\n",
       "      MCC  \n",
       "0  0.4489  "
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "predict_model(final_rf);"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "V77JC5JVEQtp"
   },
   "source": [
    "Notice how the AUC in `final_rf` has increased to **`0.8222`** from **`0.7563`**, even though the model is the same. This is because the `final_rf` variable has been trained on the complete dataset including the test/hold-out set."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "hUzc6tXNEQtr"
   },
   "source": [
    "# 13.0 Predict on unseen data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "dx5vXjChEQtt"
   },
   "source": [
    "The `predict_model()` function is also used to predict on the unseen dataset. The only difference from section 11 above is that this time we will pass the `data_unseen` parameter. `data_unseen` is the variable created at the beginning of the tutorial and contains 5% (1200 samples) of the original dataset which was never exposed to PyCaret. (see section 5 for explanation)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 211
    },
    "colab_type": "code",
    "id": "0y5KWLC6EQtx",
    "outputId": "30771f87-7847-43ce-e984-9963cff7d043"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>LIMIT_BAL</th>\n",
       "      <th>SEX</th>\n",
       "      <th>EDUCATION</th>\n",
       "      <th>MARRIAGE</th>\n",
       "      <th>AGE</th>\n",
       "      <th>PAY_1</th>\n",
       "      <th>PAY_2</th>\n",
       "      <th>PAY_3</th>\n",
       "      <th>PAY_4</th>\n",
       "      <th>PAY_5</th>\n",
       "      <th>...</th>\n",
       "      <th>BILL_AMT6</th>\n",
       "      <th>PAY_AMT1</th>\n",
       "      <th>PAY_AMT2</th>\n",
       "      <th>PAY_AMT3</th>\n",
       "      <th>PAY_AMT4</th>\n",
       "      <th>PAY_AMT5</th>\n",
       "      <th>PAY_AMT6</th>\n",
       "      <th>default</th>\n",
       "      <th>Label</th>\n",
       "      <th>Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>100000</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>23</td>\n",
       "      <td>0</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>567.0</td>\n",
       "      <td>380.0</td>\n",
       "      <td>601.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>581.0</td>\n",
       "      <td>1687.0</td>\n",
       "      <td>1542.0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.1891</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>380000</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>32</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>...</td>\n",
       "      <td>11873.0</td>\n",
       "      <td>21540.0</td>\n",
       "      <td>15138.0</td>\n",
       "      <td>24677.0</td>\n",
       "      <td>11851.0</td>\n",
       "      <td>11875.0</td>\n",
       "      <td>8251.0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.0481</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>200000</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>32</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>2</td>\n",
       "      <td>...</td>\n",
       "      <td>3151.0</td>\n",
       "      <td>5818.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>9102.0</td>\n",
       "      <td>17.0</td>\n",
       "      <td>3165.0</td>\n",
       "      <td>1395.0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.1685</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>200000</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>53</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>...</td>\n",
       "      <td>149531.0</td>\n",
       "      <td>6300.0</td>\n",
       "      <td>5500.0</td>\n",
       "      <td>5500.0</td>\n",
       "      <td>5500.0</td>\n",
       "      <td>5000.0</td>\n",
       "      <td>5000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0.7434</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>240000</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>41</td>\n",
       "      <td>1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1737.0</td>\n",
       "      <td>2622.0</td>\n",
       "      <td>3301.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>360.0</td>\n",
       "      <td>1737.0</td>\n",
       "      <td>924.0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.2173</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 26 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "   LIMIT_BAL  SEX  EDUCATION  MARRIAGE  AGE  PAY_1  PAY_2  PAY_3  PAY_4  \\\n",
       "0     100000    2          2         2   23      0     -1     -1      0   \n",
       "1     380000    1          2         2   32     -1     -1     -1     -1   \n",
       "2     200000    2          2         1   32     -1     -1     -1     -1   \n",
       "3     200000    1          1         1   53      2      2      2      2   \n",
       "4     240000    1          1         2   41      1     -1     -1      0   \n",
       "\n",
       "   PAY_5  ...  BILL_AMT6  PAY_AMT1  PAY_AMT2  PAY_AMT3  PAY_AMT4  PAY_AMT5  \\\n",
       "0      0  ...      567.0     380.0     601.0       0.0     581.0    1687.0   \n",
       "1     -1  ...    11873.0   21540.0   15138.0   24677.0   11851.0   11875.0   \n",
       "2      2  ...     3151.0    5818.0      15.0    9102.0      17.0    3165.0   \n",
       "3      2  ...   149531.0    6300.0    5500.0    5500.0    5500.0    5000.0   \n",
       "4      0  ...     1737.0    2622.0    3301.0       0.0     360.0    1737.0   \n",
       "\n",
       "   PAY_AMT6  default  Label   Score  \n",
       "0    1542.0        0      0  0.1891  \n",
       "1    8251.0        0      0  0.0481  \n",
       "2    1395.0        0      0  0.1685  \n",
       "3    5000.0        1      1  0.7434  \n",
       "4     924.0        0      0  0.2173  \n",
       "\n",
       "[5 rows x 26 columns]"
      ]
     },
     "execution_count": 35,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "unseen_predictions = predict_model(final_rf, data=data_unseen)\n",
    "unseen_predictions.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "oPYmVpugEQt5"
   },
   "source": [
    "The `Label` and `Score` columns are added onto the `data_unseen` set. Label is the prediction and score is the probability of the prediction. Notice that predicted results are concatenated to the original dataset while all the transformations are automatically performed in the background. You can also check the metrics on this since you have actual target column `default` available. To do that we will use `pycaret.utils` module. See example below:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.8125"
      ]
     },
     "execution_count": 50,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from pycaret.utils import check_metric\n",
    "check_metric(unseen_predictions.default, unseen_predictions.Label, 'Accuracy')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "L__po3sUEQt7"
   },
   "source": [
    "# 14.0 Saving the model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "1sQPT7jrEQt-"
   },
   "source": [
    "We have now finished the experiment by finalizing the `tuned_rf` model which is now stored in `final_rf` variable. We have also used the model stored in `final_rf` to predict `data_unseen`. This brings us to the end of our experiment, but one question is still to be asked: What happens when you have more new data to predict? Do you have to go through the entire experiment again? The answer is no, PyCaret's inbuilt function `save_model()` allows you to save the model along with entire transformation pipeline for later use."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "ln1YWIXTEQuA",
    "outputId": "d3cb0652-f72e-44e8-9455-824b12740bff"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Transformation Pipeline and Model Succesfully Saved\n"
     ]
    }
   ],
   "source": [
    "save_model(final_rf,'Final RF Model 08Feb2020')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "WE6f48AYEQuR"
   },
   "source": [
    "(TIP : It's always good to use date in the filename when saving models, it's good for version control.)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "Z8OBesfkEQuU"
   },
   "source": [
    "# 15.0 Loading the saved model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "V2K_WLaaEQuW"
   },
   "source": [
    "To load a saved model at a future date in the same or an alternative environment, we would use PyCaret's `load_model()` function and then easily apply the saved model on new unseen data for prediction."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "Siw_2EIUEQub",
    "outputId": "5da8b7c9-01f7-469c-f0c9-b19c8ce11bcc"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Transformation Pipeline and Model Sucessfully Loaded\n"
     ]
    }
   ],
   "source": [
    "saved_final_rf = load_model('Final RF Model 08Feb2020')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "1zyi6-Q-EQuq"
   },
   "source": [
    "Once the model is loaded in the environment, you can simply use it to predict on any new data using the same `predict_model()` function. Below we have applied the loaded model to predict the same `data_unseen` that we used in section 13 above."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "HMPO1ka9EQut"
   },
   "outputs": [],
   "source": [
    "new_prediction = predict_model(saved_final_rf, data=data_unseen)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "7wyDQQSzEQu8",
    "outputId": "23065436-42e3-4441-ed58-a8863f8971f9"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>LIMIT_BAL</th>\n",
       "      <th>SEX</th>\n",
       "      <th>EDUCATION</th>\n",
       "      <th>MARRIAGE</th>\n",
       "      <th>AGE</th>\n",
       "      <th>PAY_1</th>\n",
       "      <th>PAY_2</th>\n",
       "      <th>PAY_3</th>\n",
       "      <th>PAY_4</th>\n",
       "      <th>PAY_5</th>\n",
       "      <th>...</th>\n",
       "      <th>BILL_AMT6</th>\n",
       "      <th>PAY_AMT1</th>\n",
       "      <th>PAY_AMT2</th>\n",
       "      <th>PAY_AMT3</th>\n",
       "      <th>PAY_AMT4</th>\n",
       "      <th>PAY_AMT5</th>\n",
       "      <th>PAY_AMT6</th>\n",
       "      <th>default</th>\n",
       "      <th>Label</th>\n",
       "      <th>Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>100000</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>23</td>\n",
       "      <td>0</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>567.0</td>\n",
       "      <td>380.0</td>\n",
       "      <td>601.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>581.0</td>\n",
       "      <td>1687.0</td>\n",
       "      <td>1542.0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.1891</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>380000</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>32</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>...</td>\n",
       "      <td>11873.0</td>\n",
       "      <td>21540.0</td>\n",
       "      <td>15138.0</td>\n",
       "      <td>24677.0</td>\n",
       "      <td>11851.0</td>\n",
       "      <td>11875.0</td>\n",
       "      <td>8251.0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.0481</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>200000</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>32</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>2</td>\n",
       "      <td>...</td>\n",
       "      <td>3151.0</td>\n",
       "      <td>5818.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>9102.0</td>\n",
       "      <td>17.0</td>\n",
       "      <td>3165.0</td>\n",
       "      <td>1395.0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.1685</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>200000</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>53</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>...</td>\n",
       "      <td>149531.0</td>\n",
       "      <td>6300.0</td>\n",
       "      <td>5500.0</td>\n",
       "      <td>5500.0</td>\n",
       "      <td>5500.0</td>\n",
       "      <td>5000.0</td>\n",
       "      <td>5000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0.7434</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>240000</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>41</td>\n",
       "      <td>1</td>\n",
       "      <td>-1</td>\n",
       "      <td>-1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1737.0</td>\n",
       "      <td>2622.0</td>\n",
       "      <td>3301.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>360.0</td>\n",
       "      <td>1737.0</td>\n",
       "      <td>924.0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.2173</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 26 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "   LIMIT_BAL  SEX  EDUCATION  MARRIAGE  AGE  PAY_1  PAY_2  PAY_3  PAY_4  \\\n",
       "0     100000    2          2         2   23      0     -1     -1      0   \n",
       "1     380000    1          2         2   32     -1     -1     -1     -1   \n",
       "2     200000    2          2         1   32     -1     -1     -1     -1   \n",
       "3     200000    1          1         1   53      2      2      2      2   \n",
       "4     240000    1          1         2   41      1     -1     -1      0   \n",
       "\n",
       "   PAY_5  ...  BILL_AMT6  PAY_AMT1  PAY_AMT2  PAY_AMT3  PAY_AMT4  PAY_AMT5  \\\n",
       "0      0  ...      567.0     380.0     601.0       0.0     581.0    1687.0   \n",
       "1     -1  ...    11873.0   21540.0   15138.0   24677.0   11851.0   11875.0   \n",
       "2      2  ...     3151.0    5818.0      15.0    9102.0      17.0    3165.0   \n",
       "3      2  ...   149531.0    6300.0    5500.0    5500.0    5500.0    5000.0   \n",
       "4      0  ...     1737.0    2622.0    3301.0       0.0     360.0    1737.0   \n",
       "\n",
       "   PAY_AMT6  default  Label   Score  \n",
       "0    1542.0        0      0  0.1891  \n",
       "1    8251.0        0      0  0.0481  \n",
       "2    1395.0        0      0  0.1685  \n",
       "3    5000.0        1      1  0.7434  \n",
       "4     924.0        0      0  0.2173  \n",
       "\n",
       "[5 rows x 26 columns]"
      ]
     },
     "execution_count": 39,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "new_prediction.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "bf8I1uqcEQvD"
   },
   "source": [
    "Notice that the results of `unseen_predictions` and `new_prediction` are identical."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.8125"
      ]
     },
     "execution_count": 52,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from pycaret.utils import check_metric\n",
    "check_metric(new_prediction.default, new_prediction.Label, 'Accuracy')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "_HeOs8BhEQvF"
   },
   "source": [
    "# 16.0 Wrap-up / Next Steps?"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "VqG1NnwXEQvK"
   },
   "source": [
    "This tutorial has covered the entire machine learning pipeline from data ingestion, pre-processing, training the model, hyperparameter tuning, prediction and saving the model for later use. We have completed all of these steps in less than 10 commands which are naturally constructed and very intuitive to remember such as `create_model()`, `tune_model()`, `compare_models()`. Re-creating the entire experiment without PyCaret would have taken well over 100 lines of code in most libraries.\n",
    "\n",
    "We have only covered the basics of `pycaret.classification`. In following tutorials we will go deeper into advanced pre-processing, ensembling, generalized stacking and other techniques that allow you to fully customize your machine learning pipeline and are must know for any data scientist.\n",
    "\n",
    "See you at the next tutorial. Follow the link to __[Binary Classification Tutorial (CLF102) - Intermediate Level](https://github.com/pycaret/pycaret/blob/master/tutorials/Binary%20Classification%20Tutorial%20Level%20Intermediate%20-%20CLF102.ipynb)__"
   ]
  }
 ],
 "metadata": {
  "colab": {
   "collapsed_sections": [
    "Ui_rALqYEQmv",
    "y9s9wNcjEQn0",
    "it_nJo1IEQob",
    "P5m2pciOEQo4",
    "UWMSeyNhEQo-",
    "rWUojqBCEQpb",
    "nSg3OUjuEQpu",
    "XvpjzbGQEQqB",
    "BQlMCxrUEQqG",
    "CD-f0delEQqq",
    "KO3zIfs-EQrA",
    "w_P46O0jEQrT",
    "euqkQYJaEQrY",
    "bwyoTUDQEQrm",
    "_r9rwEw7EQrz",
    "FfWC3NEhEQr9",
    "RX5pYUJJEQsV",
    "r79BGjIfEQs1",
    "hUzc6tXNEQtr",
    "L__po3sUEQt7",
    "Z8OBesfkEQuU",
    "_HeOs8BhEQvF"
   ],
   "name": "Binary Classification Tutorial (CLF101) - Level Beginner (ACN_EDITS).ipynb",
   "provenance": []
  },
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.4"
  },
  "widgets": {
   "application/vnd.jupyter.widget-state+json": {
    "02771b4dc3284414ab05df1906f4556b": {
     "model_module": "@jupyter-widgets/controls",
     "model_name": "IntProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "IntProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "",
      "description": "Processing: ",
      "description_tooltip": null,
      "layout": "IPY_MODEL_22588a12c0db4067982e62ebbe7e6930",
      "max": 5,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_9e338844e75b4e17be8483529f5f38fd",
      "value": 5
     }
    },
    "0a06fb091bd94ce6b6ab892e2c6faadf": {
     "model_module": "@jupyter-widgets/base",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "12bf8b3c6ae8444a900474912589fdf1": {
     "model_module": "@jupyter-widgets/controls",
     "model_name": "ToggleButtonsModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ToggleButtonsModel",
      "_options_labels": [
       "Hyperparameters",
       "AUC",
       "Confusion Matrix",
       "Threshold",
       "Precision Recall",
       "Error",
       "Class Report",
       "Feature Selection",
       "Learning Curve",
       "Manifold Learning",
       "Calibration Curve",
       "Validation Curve",
       "Dimensions",
       "Feature Importance",
       "Decision Boundary"
      ],
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ToggleButtonsView",
      "button_style": "",
      "description": "Plot Type:",
      "description_tooltip": null,
      "disabled": false,
      "icons": [
       ""
      ],
      "index": 2,
      "layout": "IPY_MODEL_0a06fb091bd94ce6b6ab892e2c6faadf",
      "style": "IPY_MODEL_8886001bc7c1463ba58a8453f5c55073",
      "tooltips": []
     }
    },
    "22588a12c0db4067982e62ebbe7e6930": {
     "model_module": "@jupyter-widgets/base",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "2a81017413ca4fe789c2272a5831a069": {
     "model_module": "@jupyter-widgets/base",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "3cc1e83b91f34b289c7d52003f20a97a": {
     "model_module": "@jupyter-widgets/controls",
     "model_name": "IntProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "IntProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "",
      "description": "Processing: ",
      "description_tooltip": null,
      "layout": "IPY_MODEL_8399e21b17634116861a5abaa9c0ccf7",
      "max": 5,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_8d709ec9ec484944b1f9773748857f84",
      "value": 2
     }
    },
    "41031579127f4a53b58957e601465083": {
     "model_module": "@jupyter-widgets/base",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "42d5400d235d40b78190016ef0dabe11": {
     "model_module": "@jupyter-widgets/controls",
     "model_name": "VBoxModel",
     "state": {
      "_dom_classes": [
       "widget-interact"
      ],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "VBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "VBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_12bf8b3c6ae8444a900474912589fdf1",
       "IPY_MODEL_9bb3600d38c04691b444ff375ad5e3f5"
      ],
      "layout": "IPY_MODEL_41031579127f4a53b58957e601465083"
     }
    },
    "57b94ac505d142769b79de2f1e5c1166": {
     "model_module": "@jupyter-widgets/controls",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "8399e21b17634116861a5abaa9c0ccf7": {
     "model_module": "@jupyter-widgets/base",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "8886001bc7c1463ba58a8453f5c55073": {
     "model_module": "@jupyter-widgets/controls",
     "model_name": "ToggleButtonsStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ToggleButtonsStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "button_width": "",
      "description_width": "",
      "font_weight": ""
     }
    },
    "8d709ec9ec484944b1f9773748857f84": {
     "model_module": "@jupyter-widgets/controls",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "9bb3600d38c04691b444ff375ad5e3f5": {
     "model_module": "@jupyter-widgets/output",
     "model_name": "OutputModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/output",
      "_model_module_version": "1.0.0",
      "_model_name": "OutputModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/output",
      "_view_module_version": "1.0.0",
      "_view_name": "OutputView",
      "layout": "IPY_MODEL_4f8f81ab97b041a58a53c85a1ab97bd4",
      "msg_id": "",
      "outputs": [
       {
        "image/png": "iVBORw0KGgoAAAANSUhEUgAAAeoAAAFlCAYAAAAki6s3AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjMsIGh0\ndHA6Ly9tYXRwbG90bGliLm9yZy+AADFEAAAgAElEQVR4nO3dd3hO9//H8VciS5BIqKhoG0U0RBBa\nas8mUqNWoyqtUVojdCBWqVGqWpRSnd+qWatGkdpVpRQxW3ztmSKR0TQyz+8PP/fXLSKquZOjno/r\nynXlfD7nfM77nPvmdZ9xn9gZhmEIAACYkn1+FwAAALJHUAMAYGIENQAAJkZQAwBgYgQ1AAAmRlAD\nAGBiBDVsokKFCmrWrJmCg4MVHBysZs2aaejQofrrr79ybR3R0dGqUKFCro03ePBg1apVy1LzjZ9D\nhw7l2jqys3r1av3555+W6ePHj6tPnz5q2rSpmjVrptDQUG3atEmSdO7cOVWsWDHXaxg0aJA2btwo\nSZo0aZLq1q2rJUuWWLX/Ez/++KNCQ0MVFBSkJk2aqFevXjp+/Pg/GnPu3LmqU6eOPvnkk3taPjg4\nWFeuXPlHNdywdOlSVahQwfI63XDt2jUFBgZq8ODBOY6xb98+HT58+LZ969at05AhQ3KlVtxnDMAG\nfH19jYsXL1qmU1JSjN69exuTJk3KtXVcvHjR8PX1zbXxIiIijOnTp+faeH9HUFCQZX9FR0cbtWrV\nMubPn29kZmYahmEYe/bsMWrWrGn89NNPxtmzZw0/Pz+b1tOkSRNj27ZtuTbepk2bjDp16hi7du0y\nDMMwMjMzjQULFhhPPfWUceXKlXse96WXXjIWLlyYW2X+I0uWLDEaNGhgvPnmm1btq1evNho0aGBE\nRETkOMbbb79tLFu2zFYl4j7lkN8fFPBgcHJyUr169SxHZsnJyRoyZIh+//13paWlKSgoSBEREZKk\nsLAwNW7cWGvXrtW5c+f05JNP6sMPP5SdnZ0WL16s6dOnq3DhwmrZsqVl/MzMTH300Uf64YcfJElV\nq1bViBEj5OrqqrCwMNWrV08bNmzQ6dOnFR4ervj4eK1YsUL29vb69NNP9cgjj9yx/pzGDwwM1Nq1\na/Xuu++qXLlyGjNmjPbv36/09HT17t1b7dq1kyRNnjxZkZGRkiQvLy9NnDhRU6ZM0cmTJxUWFqbx\n48drw4YNql27tjp27GhZf7Vq1TRjxgyVLFlSmZmZVnWNGTNG27ZtU1pamqpXr65x48bJ0dFRO3fu\n1Pjx45WSkiLDMNSvXz81b9482/awsDC1b99eW7Zs0cWLFzV06FD16tVLK1euVPv27dW6dWvt3r1b\n48aNU0JCgjw8PPThhx/qkUce0dKlS7Vx40YlJiaqUqVKGjRokNX+mzZtmsLDw1W9enVJkp2dnUJD\nQ+Xl5SVnZ2dJ0jfffKMFCxYoMzNTZcqU0bvvvitPT08NHjxYpUqVUlRUlE6dOiUfHx/NmDFD06ZN\n0969e3X8+HFFR0fr/PnzevTRR9W7d29J18+Q3JieM2eO5s6dK8MwVLhwYY0fP17ly5dXhQoV9OOP\nP6pkyZJ/e/0FCxbM8j4JDAzUjh07lJycbOlfvXq16tSpo4yMjDu+9+fPn6/ly5dr48aNio2Nlbu7\nu9U+LVeunFasWKGPP/5YLVq00Mcffyx/f3/t3r1bAwcO1Pfffy9XV9c7vo9xn8rnDwr4l7r1iDou\nLs548cUXjRkzZhiGYRhffvml8corrxiZmZlGXFyc8dRTTxm//vqrYRiG0blzZ6Nz585GcnKykZSU\nZDz99NPGrl27jLi4OKNq1arGsWPHDMMwjDFjxliOqL///nvjueeeM5KSkoz09HSjV69elqPjzp07\nG6+88oqRlpZmbNy40ahSpYqxZMkSwzAMIzw83Jg8ebJhGHc+os5p/G7duhkZGRmGYRjGkCFDjEGD\nBhkZGRlGTEyM0aBBA+PIkSPG0aNHjWeeecZITU01DMMwvvnmG+O7777Lsr/atWtnLF++PNt9e/MR\ndWRkpNGiRQsjNTXVuHbtmtG8eXPLEVnbtm2NHTt2GIZhGCdPnrQc6WXX3rlzZ8uyjRo1sno9li1b\nZiQmJhpPPvmksXXrVsMwDGPlypVGmzZtDMO4fjRZtWpV4+TJk1nqTUpKMipUqGBER0dnu01RUVFG\n/fr1LUfXo0ePNoYOHWoYxvXXpXnz5sbVq1eNtLQ0o1WrVpb9c3PNt75+N6YTExONGjVqGImJiYZh\nXD/C/eyzz6z2+72u/2ZLliwxIiIijAEDBhgrV640DMMwEhMTjSZNmhiLFi2yHFHn9N6/sT237tMl\nS5YYL7/8smEYhrF27VojNDTUSE9PN9q0aWNs3rw5232L+x/XqGEzYWFhCg4OVpMmTdSkSRPVqlVL\nPXr0kCR169ZNM2bMkJ2dndzd3VW+fHmdO3fOsmxwcLBcXFzk6uoqHx8fXbx4Ufv27dNjjz2msmXL\nSpKee+45y/ybN2/Wc889J1dXVxUoUEBt27bVzz//bOlv1KiRHBwc5Ovrq+TkZAUFBUmSfH19denS\nJct833zzTZZr1LGxsTmO36BBA9nbX//ntGnTJr300kuyt7eXp6enmjVrprVr18rNzU2xsbFauXKl\n4uPjFRYWZrUNN8THx6t48eJ3tY+DgoK0ZMkSOTo6ytnZWZUrV9bZs2clScWKFdOyZct0/Phx+fj4\n6MMPP7xje052794tLy8v1alTR5LUokULnTlzRhcuXJAk+fj4yMfHJ8tyCQkJMgxDxYoVy3bszZs3\nKygoyDJPhw4dsuzfokWLWl7Dixcv3lXNkuTs7Gw5G3PlyhU1b97c8j60xfqfffZZff/995Kk9evX\nq1GjRpb3hpTze/9m2e3TZs2aqVixYurTp498fHzUoEGDu94fuP8Q1LCZ2bNnKzIyUosWLZK9vb1C\nQkLk4HD9asupU6cUHh6uZ555RsHBwTp48KDVKd3ChQtbfi9QoIAyMjIUHx+vIkWKWNrd3d0tv984\nVXhzX0xMjGW6UKFClrFunra3t7da70svvaTIyEirH09PzxzHv7kvMTFRr7/+uiXo169fr6SkJHl5\neWnatGmKjIxUw4YN1bNnz9v+h+/h4aE//vgjx/17Y7sjIiIUFBSk4OBgbdiwQcb/P75/3LhxKliw\noLp27apnnnnGcso9u/acJCQk6OzZs1YfYpycnBQbG5tlH9zM3d1d9vb2d9ym2NhYubm5Wabd3Nys\n9u/Nr/uN98PdcnR01Ndff609e/YoKChInTp10pEjR2y2/jp16ujgwYOKi4vTqlWrFBISYtWf03v/\nZtntU0nq1KmTNm3apA4dOmQ7D/4dCGrYnKenp8LCwjRx4kRL2+jRo1W+fHmtWbNGkZGReuKJJ3Ic\nx83NTYmJiZbpGwEhScWLF1dcXJxlOi4u7q6PSu/G3xm/RIkSmj59uiXoN23aZLn+XqtWLX322Wf6\n+eef9fDDD+uDDz7IsnzNmjUt18JvtmHDBm3dutWqbfLkyXJwcNDKlSsVGRlpdWRVvHhxvf3229qy\nZYtGjBihIUOGKCkpKdv2nJQoUUKPP/641YeYbdu2yd/f/47LFSxYUAEBAVq7dm2Wvq+//lpnzpzJ\nldfv1g9d8fHxlt8rVqyoqVOnavv27apbt65GjhxptWxuvn8cHR3VqFEjLVu2TKdPn1a1atWs+u/l\nvX+rzMxMTZkyRd26ddPkyZOzDXr8OxDUyBNdu3ZVVFSUdu7cKUmKiYmRn5+fChQooJ9//lmnT5/O\n8atblStX1smTJ3Xq1ClJ0nfffWfpa9iwoVasWKHk5GSlp6dr8eLFuXo68O+M37hxYy1YsECSlJ6e\nrnHjxunQoUPaunWrRo0apczMTLm6uuqJJ56QnZ2dJMnBwUEJCQmSpJdfflkHDhzQZ599ZvkPePfu\n3Ro5cqRcXFys1hUTEyNfX185OTnp8OHDioqK0l9//aW0tDSFhYVZTutXqlRJDg4OyszMvG37zadm\ns1OlShVdvnxZ+/btkySdPXtWAwcOtBzB30n//v01c+ZMbdmyRZJkGIbmzZunWbNmqUiRImrYsKHW\nrVunq1evSpIWLFjwt1+/hx56yPLVprNnz2rPnj2SpCNHjqhfv35KTU2Vk5OT/P39Lfv9htxY/82e\nffZZff7552ratGmWvju99x0cHKw+jGZn3rx58vb2VkREhDw8PDR37tx7rhXmx13fyBOFCxdWz549\nNWHCBC1evFi9evXS+PHjNWPGDDVp0kR9+/bV1KlT5efnl+0Ynp6eioiIUNeuXVWoUCGrU37BwcE6\ncuSI2rZtK8MwVLNmTb300ku5Vv/fGf/111/XqFGjLNfB69WrpwoVKigjI0OrVq1SUFCQnJyc5Onp\nqXHjxlnG79ixo8aOHauQkBDNmzdP77//vpo2bSpnZ2c99NBDmjJlimrUqGF1PbNbt26KiIjQ0qVL\nVaNGDUVERGjYsGEKCAhQ+/bt1aVLF0nXjzaHDx+uIkWK3Lb9dncw38rFxUVTp07VmDFjlJSUJEdH\nR/Xv3z9L6N1O7dq1NWnSJMvyBQoUUKVKlTR37lx5eHjIw8NDPXv21IsvvqjMzEz5+fnpnXfeyXHc\nmz3//PPq27evnnnmGVWsWNHqPoTSpUurRYsWcnR0VKFChTRixAirZQMCAv7x+m/21FNPyc7OLstp\nb0l3fO83bdpUEydO1NmzZ7N9RsAff/yhTz/9VIsWLZIkDRs2TKGhoWrWrJlKlix5zzXDvOyMu/k4\nDAAA8gWnvgEAMDGCGgAAEyOoAQAwMdPdTJaZmWm5UeVublIBAOB+ZhiG0tLSVKhQodt+A8N0QZ2U\nlKSjR4/mdxkAAOQpX19fq4fr3GC6oHZ0dJQkdf9ksC4lxOQwN4DccnL2dqVkJOd3GcADJy01TaeO\nn7Hk361MF9Q3TndfSojRxauXcpgbQG5xdnaW8TcezQkgd2V3uZebyQAAMDGCGgAAEyOoAQAwMYIa\nAAATI6gBADAxghoAABMjqAEAMDGCGgAAEyOoAQAwMYIaAAATI6gBADAxghoAABMjqAEAMDGCGgAA\nEyOoAQAwMYIaAAATI6gBADAxghoAABMjqAEAMDGCGgAAEyOoAQAwMYIaAAATI6gBADAxghoAABMj\nqAEAMDGCGgAAEyOoAQAwMYIaAAATI6gBADAxghoAABMjqAEAMDGCGgAAEyOoAQAwMYIaAAATI6gB\nADAxghoAABMjqAEAMDGCGgAAEyOoAQAwMYIaAAATI6gBADAxghoAABMjqAEAMDGCGgAAEyOoAQAw\nMYIaAAATI6gBADAxghoAABMjqAEAMDGCGgAAEyOoAQAwMYIaAAATI6gBADAxghoAABMjqAEAMDGC\nGgAAEyOoAQAwMYIaAAATI6gBADAxghoAABMjqAEAMDGCGgAAEyOoAQAwMYIaAAATI6gBADAxghoA\nABMjqAEAMDGCGlmcnL1dqWtOKnnVMauf8t5lJEkdG7XW7hlrlLD8sI5+/ZPGdh0ke/vrb6XOTdtl\nWS551TFl/HBGIzq/IUlycy2imf3f0/kFu5S86phOzt6uiNA++ba9gJldunRJPbu/qjKPlFUJj5Kq\nX7uhNm3YJEkaO+pduToWVtFCnlY/o0aMliSdPnVaBR0Kyd3Vw6q/Qlm//Nwk/E0Othw8OTlZEyZM\n0JYtWxQfH69y5cqpX79+qlOnji1Xi1zQY/IgzVq7KEt7/YBamjVwsl58L1wrtq+Tr/fj+n7s10pN\nS9PoOZM1Z/0SzVm/xGoZf58ntHXKUs3ftEyStGDYDLk4OatmeEtdiPlDTQPrafmoLxWbGKfPV8/N\nk+0D7hcd2oTKza2Itv/6s4oWLap3R49Th7ah2v/7PklS3Xp1tXZj5B3H2P/bXj3m81helAsbsOkR\n9ejRoxUVFaUvv/xS27ZtU5s2bfTaa6/pxIkTtlwtbCi8dVet3rlRi7esUmpaqg6eOqxJSz5X+HNd\nZWdnl2X+AvYF9J+BH+rdedP03/MnJUnzNy1Tj8mDdO7yRWVmZmrtrh/1+5ljqlq2Yl5vDmBq8fHx\n8qv4hCZOel8lS5aUi4uL3hr0ppKSkvTrzl/zuzzkEZsFdXx8vFauXKnw8HCVKVNGzs7O6tixo8qW\nLasFCxbYarXIJc83aKlDX2xU3LLftGv6arV6+hlJUi2/QO08stdq3p2Ho1Tc3dNyavxmvVq+JFfn\ngvpw8aeWttnrl+j4hVOSJBcnF3Vq3EblSvloweYVttsg4D7k7u6umZ9/oif8nrC0nTxx/QNv6dKl\nJUnnz5/Xs0Et5F3iET1RrqIGDxyi5ORkq3HeHjZCvo8/Ie8Sj6hl81b67dBvebcR+MdsFtSHDh1S\nWlqaKleubNUeEBCgffv22Wq1yAX7T/6uw2eOqcFb7fVIp6e09Oc1+u6dL1TTL1APuXsqNjHOav4r\nCVclSSWKFrdqL1ywkN5+sb/e/voDZWZmZlnPD+/NVfKqY3q/xzB1Gt9XPx3YYbuNAv4FEhIS9Oor\nr6lFqxaqXiNQD5d6WI8/Xkaj3x2tU+dP6IuvPtO3879VxIDBkiQnZycF1ghUg4YNtO9QlHZG7VBB\nV1c9G9RC8fHx+bw1uFs2C+rY2FhJUtGiRa3aPTw8FBMTY6vVIhe0HtFNb306WlfiY5X4158aN2+a\n9h4/pB7NO91xOcMwrKZffbazYhKvaunW1bedP2jwi3JtUU5vzhylbwZN0fMNWubaNgD/NqdPn1Hj\n+k300EMP6evZX0mSuvfoppVrVqh6jUA5Ojqqbv26GhAxQN98PVvp6el6+OGH9fMvP6l7j24qWLCg\nvL1L6dMvPtGlS5e1auWqfN4i3K18uev7dtcyYW7HLpySd/GS+iPuioq5eVj1Ff//6eirl63aOzdt\nq4U/fn/HcZNTrmnhjyv1zfoligjtnbtFA/8Su37drfpP11edunW07PvvVKhQoWznLVv2caWkpOjK\nlSu37ffw8FCxYp46f/6CrcpFLrNZUBcrVkySFBdnfZr06tWrKl68+O0WgQn4lHxEH4ePlXshN6t2\nv0fL69iFU9p2aJdqPRFo1VfX/yldiIm2XHeWpPLeZVS1bCUt+9n6blQvj4d0cvZ21atc06rd2dFJ\n6RkZubsxwL/AoYOH1PrZ5zQgYoA++niKHB0dLX0Txr2vNaus/40dPnxEhQsXlpeXlzau36jRI8dY\n9V++fFlXrsSobLmyeVI//jmbBbW/v7+cnJy0d6/1jUd79uxRjRo1bLVa/EN/XL2s1k8HaUa/cfIs\nUlSuLgX1dufX5etdRtOWfaUp332poBoN9HyDlnJydFJ13wC91b6nJi3+3GqcWn6BSktP08FTR7KM\nf+qPc5rYY7jKlvKRvb29GlaprU6NntOiLXc++gYeNBkZGerRrae6du+i8P59s/THxMSob+9w7d61\nR+np6dq6ZasmfzBZ/V4Pl52dnYp6eGjihA80dco0Xbt2TdHR0erds4/KliurZ1uE5P0G4Z7Y7HvU\nRYoUUbt27TRt2jT5+vqqZMmSmjdvns6fP6+OHTvaarX4h5JTrqnZ4Bc04ZWhOvzVjyrk4qo9xw6o\nwYAOOnru+tfqOo7ro9EvvaVvBk3RH3FXNHXZV1Z3dUtSqWIldTUxXukZ6VnW0W5UD43rNljbP1qu\nQi6uOnPpvMbM/SjLGMCD7pftOxS1Z68OHfxNH0+dbtXXqfMLmjJtsgoWLKjOL4Tp4oWL8irppTcG\nvGEJ9cDq1bRo6bcaN/Y9vTt6nCTpmeBnFLl+jZydnfN8e3Bv7Ixb7wDKRampqXr//fe1atUqJSUl\nyc/PT4MGDVL16tWzXSYlJUUHDx5Uywk9dPHqJVuVBuAWxrpzupbxV36XATxwUlNS9d/fj8vf3/+2\nH6Bs+mQyJycnDR8+XMOHD7flagAA+NfiWd8AAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJ\nEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHU\nAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAA\nmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgY\nQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJhYjkF98OBBbdq0SZI0efJkvfzyy9q1a5fN\nCwMAAHcR1GPHjlWZMmW0a9cuHThwQG+//bamTp2aF7UBAPDAyzGonZ2d5ePjow0bNuj5559XuXLl\nZG/PGXMAAPJCjombnJysNWvWaP369apbt67i4uKUkJCQF7UBAPDAyzGo33zzTa1cuVJvvPGGChcu\nrNmzZ6tLly55UBoAAHDIaYZatWrJ399fhQsX1pUrV/T0008rMDAwL2oDAOCBl+MR9ZgxY7RmzRrF\nxcWpY8eOmjNnjt555508KA0AAOQY1L/99ps6dOigNWvWqE2bNpoyZYpOnz6dF7UBAPDAyzGoDcOQ\nJG3evFmNGzeWJKWmptq2KgAAIOkugrpMmTIKCQlRUlKS/Pz8tGzZMrm7u+dFbQAAPPByvJls7Nix\nOnr0qMqWLStJKleunHr37m3zwgAAwF0EtSRdunRJR44ckXT9tPfMmTO1ceNGmxYGAADuIqgHDhyo\n+Ph4HTlyRIGBgdq3b5/Cw8PzojYAAB54OV6jjo6O1pdffqkyZcpo6tSpmjdvng4cOJAXtQEA8MC7\n64d2p6enKyUlRd7e3jp27JgtawIAAP/vrp5M9vnnn6tp06Zq06aNSpcurczMzLyoDQCAB16OQd2v\nXz9lZGSoQIECqlatmmJiYlSnTp28qA0AgAdetkG9ePHibBdavXq12rdvb5OCAADA/2Qb1Lt3777j\nggQ1AAC2l21Qjx8/XpmZmbK3t77fLC0tTY6OjjYvDAAA3OGu73PnzikkJESJiYmWtv3796tt27aK\njY3Nk+IAAHjQZRvU48ePV9++fVWkSBFLW0BAgHr16qX33nsvT4oDAOBBl21QX7lyRS1atMjSHhIS\novPnz9u0KAAAcF22QZ2enp7tQsnJyTYpBgAAWMv2ZjI3Nzft379fAQEBVu07d+6Uh4eHzQtzP5Cs\na3/8ZfP1APgflwKu+V0C8MCxK1Dgjv3ZBvUbb7yh8PBwtW7dWpUrV1ZGRoZ2796tH374QXPmzMn1\nQm/1w/ZVcnC6c/EAco+np6cuXD6X32UAD5zUjNQ79md76jsgIEBLliyRvb29li9frtWrV8vd3V3L\nly/Xo48+muuFAgCArO74CNHixYvr9ddfz6taAADALe76r2cBAIC8R1ADAGBidxXUV69e1YEDBySJ\nP3EJAEAeyjGov//+e4WGhmrIkCGSpDFjxmjRokU2LwwAANxFUP/nP//R8uXLLd+djoiI0MKFC21e\nGAAAuIugLlKkiAoWLGiZdnFx4a9nAQCQR+749SxJ8vDw0HfffaeUlBQdOnRIq1evlqenZ17UBgDA\nAy/HI+pRo0bpwIEDSkpK0vDhw5WSkqKxY8fmRW0AADzwcjyidnNz04gRI/KiFgAAcIscg7pBgway\ns7PL0r5582Zb1AMAAG6SY1DPmzfP8ntaWpq2b9+ulJQUmxYFAACuyzGovb29raZ9fHzUvXt3denS\nxVY1AQCA/5djUG/fvt1qOjo6WmfOnLFZQQAA4H9yDOoZM2ZYfrezs1PhwoU1atQomxYFAACuyzGo\nBw8erEqVKuVFLQAA4BY5fo96woQJeVEHAAC4jRyPqEuVKqWwsDBVqVLF6tGh/fv3t2lhAADgLoK6\ndOnSKl26dF7UAgAAbpFtUK9YsUKtWrVS375987IeAABwk2yvUS9evDgv6wAAALeR481kAAAg/2R7\n6jsqKkoNGzbM0m4Yhuzs7HjWNwAAeSDboK5YsaImTZqUl7UAAIBbZBvUTk5OWZ7zDQAA8la216gD\nAgLysg4AAHAb2Qb1wIED87IOAABwG9z1DQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhB\nDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0A\ngIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJ\nEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHU\nAACYGEENAICJEdQAAJgYQY3bOnPqrNoHh8q7kI/Onj5r1bds4XIF1X5Wvl6VVCegod57Z6IyMjIs\n/adPnlGPTq8p4LHqqugdoOdDOulA1EFL/+Oevll+HnMvp1oV6+bZ9gH3m20/b1chpyIaO+pdSVJa\nWpreeXuUKvr6q5jbQ6ro66+3h45QamqqZZmEhAT1ea2vvEs8ouLuJdS4flNF7YnKr03APSKokcWa\nFZFq2bCNvB/xztK3/adf9HrPAeo7oLcOnNmjL+bN1NIFy/TRhGmSpGvXrqljixflWshVP+3bqB2/\n/6yHvUvq5fbddO3aNUnSidijVj/HrhxWtSerKjSsQ55uJ3C/SE5O1quvvKYiRYpY2saNGa+vv/pa\n8xfO1aWr0Zq/cK5mz5qtCePet8zTuWOYzpw+ox17ftHxM/9V/Qb1NHL4O8rMzMyPzcA9smlQnz17\nVmFhYapQoYLOnTtny1UhF8VdjdfSdQvV7oW2Wfq+mjlLjYMaqmXbZ+Xs7Cw//yfUM7y7vpo5S5mZ\nmboUfVk16zylke+9Lfei7iriVkQ9+nbXH9GXdOzwsduu74vpXynpzyT1HdDb1psG3JdGDBupChV8\nFVAlwNK2Z/ce1a1fT1WqVlGBAgVUpWoV1WtQX7t+3SVJ2rnjV23auFkzv5ip0qW95e7urnfGjNSK\n1ctlb88x2v3EZq/WunXrFBoaqlKlStlqFbCRF14OVdnyj9+2b8/OKFWtUdWqrWqNKroac1Unjp3U\noz6PaMpnH8qzmIel/8yps6YqFp8AAA2CSURBVCpQoIC8HvbKMt6l6EuaOGaSxk0ZK0dHx9zdEOBf\n4Oet2zRvznxNnTHVqr1NuzbasvlH7fp1tzIyMnRg/wFt3fKT2rZvI0n6cdNm+ZTx0fLvluuJchVV\n6qHSatuqnU4cP5EPW4F/wmZBHRcXp7lz56p169a2WgXyQeyVWBX1cLdq8yzmKUmKuRyTZf6LF6L1\n9oB31OXVl/SQ10NZ+ieN/0i16z+tJ2tVt03BwH3sr7/+0quvvKb3Jo5TqVIPW/V16fayunbvqvq1\nG6iIi7tqVn9aoS+E6uWuL0uSzp07r/Pnzuu3Q7/pl13btDNqh1JSUtS2dXulpaXlx+bgHtksqDt0\n6KAyZcrYaniYkJ2dndX0wX2H1LJhG9VpUFsj3xueZf4/Ll7S/K+/Vb9BffKqROC+MmL4SJUvX05h\nL4dl6Zv84RTNn7dAm37aqKt/xmjLth+1fNkKjRszXpJkGIbS09P1weSJKlq0qEqX9tbESe/ryOEj\n2vHLzrzeFPwDXKjA31K8RHFdjY2zaouNiZUkqyPmDZGb1C4oVJ27d9LULyapQIECWcZasWSlSpby\nUvWnAm1bNHAf+nnrNs2bPV8fz/z4tv0fTfpIr/bqqZq1npKzs7NqPFldr/V+VZ9MnylJevjhh+Xq\n6ioXFxfLMo+XvX5J6/z587bfAOQah/wuAPeXGrUCtWen9dc7ft22S14lS8jn8cckSVs3b1Ovl/tq\n0syJatEmJNuxVi5dpaBnm9m0XuB+Nes/s5SUlKSagbUsbfHx8dr16y6t+n6VMjIylXnT1yIlKT09\n3XJHt3+Av+Lj43Xsv8dUrnw5SdLxY8clST4+PnmzEcgVHFHjb3mlTzf9uH6Lli9eqZSUFO3bs1+f\nTv1cPcNfkZ2dnZL+TNLrPd/S8HeH3DGk09PTdSDqoCpVqZSH1QP3jwkfvKdDRw/ql93bLT+B1QP1\nSs/u+m7lUj3XtrU+/+xLRe2JstxM9uXnX6lDaHtJUnDzIPlV9FPfXuGKjo7W5cuXFTFgsAJrBOqp\nmk/m89bh7+CIGlnUq9pY58+cU2amIUmqX7WJ7Oykdi+01cTp72nGrGn6YMwkvd7jLRUvUVzdenfV\nq/17SJIiV67VxfMX9c6g0Xpn0GircftFhOv1iHBJ129KS01NVfGHiuftxgH3CQ8PD3l4eFi1OTs7\ny83NTSVLltR7E8fLzc1NnV94SRfOX1DRou7q1LmTho0YKklydHTU8lXL9Gb/txTgV1WGYSioeZC+\nnPVFlvtJYG52hmEYtlzBtm3b1LVrV23YsEGlS5fOcf6UlBQdPHhQD5X1kINT1uuaAGzDv3Q1XbjM\n8w6AvJaakqr//n5c/v7+cnZ2ztJvsyPqoKAgXbhwQTc+BwQHB8vOzk6tW7fW2LFjbbVaAAD+VWwW\n1D/88IOthgYA4IHBzWQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR\n1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQA\nAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACY\nGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhB\nDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0A\ngIkR1AAAmBhBDQCAiRHUAACYGEENAICJEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJ\nEdQAAJgYQQ0AgIkR1AAAmBhBDQCAiRHUAACYGEENAICJOeR3AbcyDEOSlJGWkc+VAA8WLy8vpaak\n5ncZwAMnLTVN0v/y71Z2RnY9+SQxMVFHjx7N7zIAAMhTvr6+KlKkSJZ20wV1ZmamkpKS5OjoKDs7\nu/wuBwAAmzIMQ2lpaSpUqJDs7bNekTZdUAMAgP/hZjIAAEyMoAYAwMQIagAATIygBgDAxAhqAABM\njKAGAMDECGoAAEzMdI8Qxf3j1KlTWrBggfbu3avY2FjZ2dmpePHiqlGjhjp27KiHH344v0sEgPse\nR9S4J9u2bVOrVq20Y8cO+fr6qnnz5goODlbZsmW1ceNGPfvss9q7d29+lwk8sEaMGJHfJSCX8GQy\n3JOOHTuqTZs2Cg0NvW3/l19+qXXr1mnBggV5XBkASapSpYr27duX32UgF3DqG/fk+PHjatOmTbb9\nL774oqZNm5aHFQEPjgsXLtyx3zCMbP8SE+4/BDXuiZubm6Kjo/Xoo4/etj86Olqurq55XBXwYGjc\nuPEd/2iRYRj8UaN/EYIa96RevXrq37+/wsPDVblyZbm7u0uS4uLitG/fPk2dOlUtWrTI5yqBf6cn\nn3xSpUuXVqtWrW7bbxiGXn311TyuCrbCNWrck2vXrmnUqFFauXKlMjIyrPocHR3Vrl07DR06VI6O\njvlUIfDvdfbsWXXs2FHz5s3TY489dtt5uEb970FQ4x9JSEjQoUOHFBsbK0kqVqyY/P39Vbhw4Xyu\nDPh3W79+veLj49WuXbvb9gcHBysyMjKPq4ItENQAAJgY36MGAMDECGoAAEyMoAby2Llz5+Tv76+w\nsDCFhYWpY8eOeuutt5SQkHDPYy5atEiDBw+WJL3xxhv6448/sp13z549Onv27F2PnZ6ergoVKty2\nb//+/erSpYvatm2rDh06qFevXpaxBw8erEWLFv2NrQBwOwQ1kA88PT01e/ZszZ49WwsWLFCJEiX0\nySef5MrYkydPlpeXV7b9S5cu/VtBnZ3Lly+rb9++6t+/v5YuXapFixYpJCREr7zyitLT0//x+ACu\n43vUgAk8+eST+vbbbyVdf5hF8+bNdfbsWU2dOlWrV6/WnDlzZBiGPD09NXbsWHl4eGju3LmaP3++\nSpYsqRIlSljGaty4sf7zn//okUce0dixY3Xw4EFJUteuXeXg4KDIyEjt379fQ4YM0WOPPaZRo0Yp\nOTlZf/31l958803Vrl1bJ06c0MCBA1WwYEHVrFnztjXPmTNHrVq1UrVq1SxtLVu2VP369eXgYP1f\ny0cffaTt27dLkkqWLKmJEyfKzs5Ow4cP18mTJ2VnZyc/Pz+NHDlSv/zyiz788EO5uLgoNTVVw4YN\nU0BAQK7ub+B+QlAD+SwjI0Pr1q1T9erVLW0+Pj4aOHCgLl68qJkzZ2rx4sVycnLSrFmz9Omnn6pP\nnz6aOnWqIiMj5eHhoV69elkeOnPDihUrdOXKFS1cuFAJCQkaMGCAPvnkE/n5+alXr156+umn1bNn\nT3Xr1k21atXS5cuXFRoaqrVr12r69Olq166dOnXqpLVr19627mPHjt32gRu31pGenq6CBQtq3rx5\nsre3V/fu3bV161Z5eXlp3759WrNmjSRp4cKFSkxM1KxZs9S1a1eFhIToxIkTOnny5D/dxcB9jaAG\n8kFsbKzCwsIkSZmZmapRo4a6dOli6b9xlBoVFaXLly+re/fukqTU1FSVLl1ap0+flre3tzw8PCRJ\nNWvW1OHDh63WsX//fsvRsJubmz777LMsdezYsUNJSUmaPn26JMnBwUExMTE6evSoevbsKUmqVavW\nbbehQIECWR52czsODg6yt7dXp06d5ODgoBMnTujq1auqXbu2PDw81KNHDzVq1EjNmzdXkSJF1LJl\nS02aNEn79+9XkyZN1KRJkxzXAfybEdRAPrhxjTo7N57o5uTkpICAAH366adW/QcOHLB6lnNmZmaW\nMezs7G7bfjMnJydNmzZNnp6eVu2GYcje/votLNmFsa+vr/bs2aOQkBCr9n379lmdqt69e7eWLFmi\nJUuWyNXVVf369ZMkOTs7a968eTp06JA2bdqk9u3ba/78+QoJCVHdunW1detWTZ8+XQEBAXrzzTfv\nuB3Avxk3kwEmVrlyZe3fv1+XL1+WJK1Zs0br16/Xo48+qnPnzikhIUGGYViu/96sWrVq+umnnyRJ\nf/75pzp06KDU1FTZ2dkpLS1NklS9enXLqefY2Fi9++67kqSyZcta/p747caWpE6dOikyMlK//PKL\npW316tUaNmyYZXxJiomJkbe3t1xdXXX+/Hnt3btXqampOnDggL777jtVqlRJffv2VaVKlXTq1ClN\nnTpVGRkZCgkJ0bBhwxQVFfVPdyNwX+OIGjAxLy8vDRs2TK+++qoKFiwoFxcXTZgwQe7u7nrttdf0\n4osvytvbW97e3rp27ZrVss2bN9eePXvUsWNHZWRkqGvXrnJyclKdOnU0cuRIDR06VMOGDdOIESO0\natUqpaamqlevXpKkPn36KCIiQpGRkapWrVqWm8Ok62cF5syZozFjxmjChAlycXGRt7e3vv76azk5\nOVnmq1Onjr766iu98MILKl++vMLDwzV9+nR99NFH+uGHH/Ttt9/KyclJjz76qAIDA3Xx4kV169ZN\nbm5uyszMVHh4uG13MmByPEIUAAAT49Q3AAAmRlADAGBiBDUAACZGUAMAYGIENQAAJkZQAwBgYgQ1\nAAAm9n9QR+M8QEgGtgAAAABJRU5ErkJggg==\n",
        "metadata": {
         "tags": []
        },
        "output_type": "display_data",
        "text/plain": "<Figure size 576x396 with 1 Axes>"
       }
      ]
     }
    },
    "9e338844e75b4e17be8483529f5f38fd": {
     "model_module": "@jupyter-widgets/controls",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "d5b6fce1763b4b54898ff3397b0f5bb0": {
     "model_module": "@jupyter-widgets/controls",
     "model_name": "IntProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "IntProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "",
      "description": "Processing: ",
      "description_tooltip": null,
      "layout": "IPY_MODEL_2a81017413ca4fe789c2272a5831a069",
      "max": 5,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_57b94ac505d142769b79de2f1e5c1166",
      "value": 5
     }
    }
   }
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}
